| Git Clone URL: | https://aur.archlinux.org/ollama-rocm-git.git (read-only, click to copy) |
|---|---|
| Package Base: | ollama-rocm-git |
| Description: | Create, run and share large language models (LLMs) with ROCm |
| Upstream URL: | https://github.com/ollama/ollama |
| Licenses: | MIT |
| Conflicts: | ollama |
| Provides: | ollama |
| Submitter: | sr.team |
| Maintainer: | wgottwalt |
| Last Packager: | wgottwalt |
| Votes: | 5 |
| Popularity: | 0.142176 |
| First Submitted: | 2024-02-28 00:40 (UTC) |
| Last Updated: | 2025-04-18 04:05 (UTC) |
You are aware what the function pkgver() in the PKGBUILD does, right? I'm really waiting for the day someone uses the outdated flag...
And you also recognized the ollama.service file and that it includes the line Environment='LD_LIBRARY_PATH=/usr/lib/ollama' right?
I'm aware that my answer is a but harsh, but damn it, why?!?
updating helps with ROCm:
diff --git a/PKGBUILD b/PKGBUILD
index b8242f6..72cebd3 100644
--- a/PKGBUILD
+++ b/PKGBUILD
@@ -1,7 +1,7 @@
# Maintainer: Wilken Gottwalt <wilken dot gottwalt at posteo dot net>
pkgname=ollama-rocm-git
-pkgver=0.4.1.git+c2e8cbaa
+pkgver=0.4.2.git+4759d879
pkgrel=1
pkgdesc='Create, run and share large language models (LLMs) with ROCm'
arch=(x86_64)
interestingly though, it doesn't pick up the shared libraries and I have to run it like this:
env LD_LIBRARY_PATH=/usr/lib/ollama/ ollama serve
any ideas?
Anyone who is late to read the comment from wgottwalt here and endedup broken rocm libraries. You can downgrade to 6.0.2 by the following snippet.
sudo pacman -U file:///var/cache/pacman/pkg/rocm-opencl-sdk-6.0.2-1-any.pkg.tar.zst
sudo pacman -U file:///var/cache/pacman/pkg/rocalution-6.0.2-2-x86_64.pkg.tar.zst
sudo pacman -U file:///var/cache/pacman/pkg/rocsparse-6.0.2-2-x86_64.pkg.tar.zst
sudo pacman -U file:///var/cache/pacman/pkg/rocm-hip-sdk-6.0.2-1-any.pkg.tar.zst
sudo pacman -U file:///var/cache/pacman/pkg/rocsolver-6.0.2-3-x86_64.pkg.tar.zst
sudo pacman -U file:///var/cache/pacman/pkg/rocthrust-6.0.2-1-x86_64.pkg.tar.zst
sudo pacman -U file:///var/cache/pacman/pkg/rocm-ml-sdk-6.0.2-1-any.pkg.tar.zst
sudo pacman -U file:///var/cache/pacman/pkg/rocblas-6.0.2-1-x86_64.pkg.tar.zst
sudo pacman -U file:///var/cache/pacman/pkg/rocrand-6.0.2-1-x86_64.pkg.tar.zst
sudo pacman -U file:///var/cache/pacman/pkg/rocfft-6.0.2-1-x86_64.pkg.tar.zst
sudo pacman -U file:///var/cache/pacman/pkg/rccl-6.0.2-1-x86_64.pkg.tar.zst
sudo pacman -U file:///var/cache/pacman/pkg/rocm-hip-libraries-6.0.2-1-any.pkg.tar.zst
sudo pacman -U file:///var/cache/pacman/pkg/rocm-ml-libraries-6.0.2-1-any.pkg.tar.zst
Looks like the ROCm 6.2.2-1 SDK has a malfunctioning compiler. It produces a broken ollama binary (fp16 issues). You may need to stay with ROCm 6.0.2 for now. I don't know if this got fixed in a newer build release. But the initial SDK version "-1" is broken.
ROCm 6.2.4 fixes this issue completely.
this does not work with this git version but with the non-git from offical arch 0.3.5-1
the model runs without problems if downloaded with the non-git version.
ollama run llama3.1:8b
pulling manifest
Error: pull model manifest: 412:
The model you are attempting to pull requires a newer version of Ollama.
Please download the latest version at:
https://ollama.com/download
@dreieck this solution produce errors on cleanup stage with removing GO packages
In prepare():
export GOPATH="${srcdir}/go"
go get
In build():
export GOPATH="${srcdir}/go"
@dreieck I don't know how to make it in 'go'
Can you please move the go download stuff out of build() and into prepare(), so that build() can take place in an offline environment?:
==> Starting build()...
go: downloading github.com/pdevine/tensor v0.0.0-20240228013915-64ccaa8d9ca9
go: downloading github.com/x448/float16 v0.8.4
go: downloading golang.org/x/exp v0.0.0-20230817173708-d852ddb80c63
go: downloading golang.org/x/sync v0.3.0
go: downloading github.com/d4l3k/go-bfloat16 v0.0.0-20211005043715-690c3bdd05f1
go: downloading github.com/gin-gonic/gin v1.9.1
go: downloading golang.org/x/term v0.13.0
go: downloading github.com/emirpasic/gods v1.18.1
go: downloading github.com/gin-contrib/cors v1.4.0
[...]
Regards and thanks for maintaining!
pkgver() needs fixes:
==> ERROR: pkgver is not allowed to contain colons, forward slashes, hyphens or whitespace.
==> ERROR: pkgver() generated an invalid version: 0.1.30-rc1.gc2712b55
(I added | tr '-' '.' to fix this.)
Regards and thanks for maintaining!
Pinned Comments
wgottwalt commented on 2024-11-09 10:46 (UTC) (edited on 2024-11-26 15:23 (UTC) by wgottwalt)
Looks like the ROCm 6.2.2-1 SDK has a malfunctioning compiler. It produces a broken ollama binary (fp16 issues). You may need to stay with ROCm 6.0.2 for now. I don't know if this got fixed in a newer build release. But the initial SDK version "-1" is broken.
ROCm 6.2.4 fixes this issue completely.