Package Details: ollama-rocm-git 0.5.3.git+2cde4b88-1

Git Clone URL: https://aur.archlinux.org/ollama-rocm-git.git (read-only, click to copy)
Package Base: ollama-rocm-git
Description: Create, run and share large language models (LLMs) with ROCm
Upstream URL: https://github.com/ollama/ollama
Licenses: MIT
Conflicts: ollama
Provides: ollama
Submitter: sr.team
Maintainer: wgottwalt
Last Packager: wgottwalt
Votes: 4
Popularity: 0.56
First Submitted: 2024-02-28 00:40 (UTC)
Last Updated: 2024-12-17 06:59 (UTC)

Required by (25)

Sources (4)

Pinned Comments

wgottwalt commented on 2024-11-09 10:46 (UTC) (edited on 2024-11-26 15:23 (UTC) by wgottwalt)

Looks like the ROCm 6.2.2-1 SDK has a malfunctioning compiler. It produces a broken ollama binary (fp16 issues). You may need to stay with ROCm 6.0.2 for now. I don't know if this got fixed in a newer build release. But the initial SDK version "-1" is broken.

ROCm 6.2.4 fixes this issue completely.

Latest Comments

1 2 3 Next › Last »

rakatan commented on 2024-11-19 14:25 (UTC)

@wgottwalt

You are aware what the function pkgver() in the PKGBUILD does, right? I'm really waiting for the day someone uses the outdated flag...

not really, having seen no other place referencing a commit I assumed this would be the place - how else is the commit pinned if it's only referenced here? My assumption got sort of confirmed by it just working with ROCm (as I saw there is a commit adding compiler flags wrt fp16 in between these two).

what outdated flag do you mean?

In short, I'm rather new to Arch, so still learning the structure, and the community expectations.

And you also recognized the ollama.service file and that it includes the line Environment='LD_LIBRARY_PATH=/usr/lib/ollama' right?

likewise, I was not aware - is that the only expected way to use ollama? ollama serve is a command available on a binary on the PATH - should I be aware to not use it and only use it via systemd?

I'm aware that my answer is a but harsh, but damn it, why?!?

harsh and informative is good - at times. why what? ;)

wgottwalt commented on 2024-11-19 08:33 (UTC)

You are aware what the function pkgver() in the PKGBUILD does, right? I'm really waiting for the day someone uses the outdated flag...

And you also recognized the ollama.service file and that it includes the line Environment='LD_LIBRARY_PATH=/usr/lib/ollama' right?

I'm aware that my answer is a but harsh, but damn it, why?!?

rakatan commented on 2024-11-18 22:38 (UTC)

updating helps with ROCm:

diff --git a/PKGBUILD b/PKGBUILD
index b8242f6..72cebd3 100644
--- a/PKGBUILD
+++ b/PKGBUILD
@@ -1,7 +1,7 @@
 # Maintainer: Wilken Gottwalt <wilken dot gottwalt at posteo dot net>

 pkgname=ollama-rocm-git
-pkgver=0.4.1.git+c2e8cbaa
+pkgver=0.4.2.git+4759d879
 pkgrel=1
 pkgdesc='Create, run and share large language models (LLMs) with ROCm'
 arch=(x86_64)

interestingly though, it doesn't pick up the shared libraries and I have to run it like this:

env LD_LIBRARY_PATH=/usr/lib/ollama/ ollama serve

any ideas?

risyasin commented on 2024-11-13 10:48 (UTC)

Anyone who is late to read the comment from wgottwalt here and endedup broken rocm libraries. You can downgrade to 6.0.2 by the following snippet.

sudo pacman -U file:///var/cache/pacman/pkg/rocm-opencl-sdk-6.0.2-1-any.pkg.tar.zst
sudo pacman -U file:///var/cache/pacman/pkg/rocalution-6.0.2-2-x86_64.pkg.tar.zst
sudo pacman -U file:///var/cache/pacman/pkg/rocsparse-6.0.2-2-x86_64.pkg.tar.zst
sudo pacman -U file:///var/cache/pacman/pkg/rocm-hip-sdk-6.0.2-1-any.pkg.tar.zst
sudo pacman -U file:///var/cache/pacman/pkg/rocsolver-6.0.2-3-x86_64.pkg.tar.zst
sudo pacman -U file:///var/cache/pacman/pkg/rocthrust-6.0.2-1-x86_64.pkg.tar.zst
sudo pacman -U file:///var/cache/pacman/pkg/rocm-ml-sdk-6.0.2-1-any.pkg.tar.zst
sudo pacman -U file:///var/cache/pacman/pkg/rocblas-6.0.2-1-x86_64.pkg.tar.zst
sudo pacman -U file:///var/cache/pacman/pkg/rocrand-6.0.2-1-x86_64.pkg.tar.zst
sudo pacman -U file:///var/cache/pacman/pkg/rocfft-6.0.2-1-x86_64.pkg.tar.zst
sudo pacman -U file:///var/cache/pacman/pkg/rccl-6.0.2-1-x86_64.pkg.tar.zst
sudo pacman -U file:///var/cache/pacman/pkg/rocm-hip-libraries-6.0.2-1-any.pkg.tar.zst
sudo pacman -U file:///var/cache/pacman/pkg/rocm-ml-libraries-6.0.2-1-any.pkg.tar.zst

wgottwalt commented on 2024-11-09 10:46 (UTC) (edited on 2024-11-26 15:23 (UTC) by wgottwalt)

Looks like the ROCm 6.2.2-1 SDK has a malfunctioning compiler. It produces a broken ollama binary (fp16 issues). You may need to stay with ROCm 6.0.2 for now. I don't know if this got fixed in a newer build release. But the initial SDK version "-1" is broken.

ROCm 6.2.4 fixes this issue completely.

z3n commented on 2024-08-13 10:52 (UTC)

this does not work with this git version but with the non-git from offical arch 0.3.5-1

the model runs without problems if downloaded with the non-git version.

ollama run llama3.1:8b
pulling manifest
Error: pull model manifest: 412:

The model you are attempting to pull requires a newer version of Ollama.

Please download the latest version at:

https://ollama.com/download

sr.team commented on 2024-04-18 02:08 (UTC)

@dreieck this solution produce errors on cleanup stage with removing GO packages

dreieck commented on 2024-04-17 12:45 (UTC)

@dreieck I don't know how to make it in 'go'

In prepare(): 

export GOPATH="${srcdir}/go"
go get

In build(): 

export GOPATH="${srcdir}/go"

sr.team commented on 2024-03-25 23:12 (UTC)

@dreieck I don't know how to make it in 'go'

dreieck commented on 2024-03-25 23:01 (UTC)

Can you please move the go download stuff out of build() and into prepare(), so that build() can take place in an offline environment?: 

==> Starting build()...
go: downloading github.com/pdevine/tensor v0.0.0-20240228013915-64ccaa8d9ca9
go: downloading github.com/x448/float16 v0.8.4
go: downloading golang.org/x/exp v0.0.0-20230817173708-d852ddb80c63
go: downloading golang.org/x/sync v0.3.0
go: downloading github.com/d4l3k/go-bfloat16 v0.0.0-20211005043715-690c3bdd05f1
go: downloading github.com/gin-gonic/gin v1.9.1
go: downloading golang.org/x/term v0.13.0
go: downloading github.com/emirpasic/gods v1.18.1
go: downloading github.com/gin-contrib/cors v1.4.0
[...]

Regards and thanks for maintaining!

1 2 3 Next › Last »