Package Details: ollama-rocm-git 0.5.13.git+bebb6823-1

Git Clone URL: https://aur.archlinux.org/ollama-rocm-git.git (read-only, click to copy)
Package Base: ollama-rocm-git
Description: Create, run and share large language models (LLMs) with ROCm
Upstream URL: https://github.com/ollama/ollama
Licenses: MIT
Conflicts: ollama
Provides: ollama
Submitter: sr.team
Maintainer: wgottwalt
Last Packager: wgottwalt
Votes: 5
Popularity: 0.36
First Submitted: 2024-02-28 00:40 (UTC)
Last Updated: 2025-03-01 10:14 (UTC)

Required by (40)

Sources (4)

Pinned Comments

wgottwalt commented on 2024-11-09 10:46 (UTC) (edited on 2024-11-26 15:23 (UTC) by wgottwalt)

Looks like the ROCm 6.2.2-1 SDK has a malfunctioning compiler. It produces a broken ollama binary (fp16 issues). You may need to stay with ROCm 6.0.2 for now. I don't know if this got fixed in a newer build release. But the initial SDK version "-1" is broken.

ROCm 6.2.4 fixes this issue completely.

Latest Comments

« First ‹ Previous 1 2 3 4 Next › Last »

rakatan commented on 2024-11-18 22:38 (UTC)

updating helps with ROCm:

diff --git a/PKGBUILD b/PKGBUILD
index b8242f6..72cebd3 100644
--- a/PKGBUILD
+++ b/PKGBUILD
@@ -1,7 +1,7 @@
 # Maintainer: Wilken Gottwalt <wilken dot gottwalt at posteo dot net>

 pkgname=ollama-rocm-git
-pkgver=0.4.1.git+c2e8cbaa
+pkgver=0.4.2.git+4759d879
 pkgrel=1
 pkgdesc='Create, run and share large language models (LLMs) with ROCm'
 arch=(x86_64)

interestingly though, it doesn't pick up the shared libraries and I have to run it like this:

env LD_LIBRARY_PATH=/usr/lib/ollama/ ollama serve

any ideas?

risyasin commented on 2024-11-13 10:48 (UTC)

Anyone who is late to read the comment from wgottwalt here and endedup broken rocm libraries. You can downgrade to 6.0.2 by the following snippet.

sudo pacman -U file:///var/cache/pacman/pkg/rocm-opencl-sdk-6.0.2-1-any.pkg.tar.zst
sudo pacman -U file:///var/cache/pacman/pkg/rocalution-6.0.2-2-x86_64.pkg.tar.zst
sudo pacman -U file:///var/cache/pacman/pkg/rocsparse-6.0.2-2-x86_64.pkg.tar.zst
sudo pacman -U file:///var/cache/pacman/pkg/rocm-hip-sdk-6.0.2-1-any.pkg.tar.zst
sudo pacman -U file:///var/cache/pacman/pkg/rocsolver-6.0.2-3-x86_64.pkg.tar.zst
sudo pacman -U file:///var/cache/pacman/pkg/rocthrust-6.0.2-1-x86_64.pkg.tar.zst
sudo pacman -U file:///var/cache/pacman/pkg/rocm-ml-sdk-6.0.2-1-any.pkg.tar.zst
sudo pacman -U file:///var/cache/pacman/pkg/rocblas-6.0.2-1-x86_64.pkg.tar.zst
sudo pacman -U file:///var/cache/pacman/pkg/rocrand-6.0.2-1-x86_64.pkg.tar.zst
sudo pacman -U file:///var/cache/pacman/pkg/rocfft-6.0.2-1-x86_64.pkg.tar.zst
sudo pacman -U file:///var/cache/pacman/pkg/rccl-6.0.2-1-x86_64.pkg.tar.zst
sudo pacman -U file:///var/cache/pacman/pkg/rocm-hip-libraries-6.0.2-1-any.pkg.tar.zst
sudo pacman -U file:///var/cache/pacman/pkg/rocm-ml-libraries-6.0.2-1-any.pkg.tar.zst

wgottwalt commented on 2024-11-09 10:46 (UTC) (edited on 2024-11-26 15:23 (UTC) by wgottwalt)

Looks like the ROCm 6.2.2-1 SDK has a malfunctioning compiler. It produces a broken ollama binary (fp16 issues). You may need to stay with ROCm 6.0.2 for now. I don't know if this got fixed in a newer build release. But the initial SDK version "-1" is broken.

ROCm 6.2.4 fixes this issue completely.

z3n commented on 2024-08-13 10:52 (UTC)

this does not work with this git version but with the non-git from offical arch 0.3.5-1

the model runs without problems if downloaded with the non-git version.

ollama run llama3.1:8b
pulling manifest
Error: pull model manifest: 412:

The model you are attempting to pull requires a newer version of Ollama.

Please download the latest version at:

https://ollama.com/download

sr.team commented on 2024-04-18 02:08 (UTC)

@dreieck this solution produce errors on cleanup stage with removing GO packages

dreieck commented on 2024-04-17 12:45 (UTC)

@dreieck I don't know how to make it in 'go'

In prepare(): 

export GOPATH="${srcdir}/go"
go get

In build(): 

export GOPATH="${srcdir}/go"

sr.team commented on 2024-03-25 23:12 (UTC)

@dreieck I don't know how to make it in 'go'

dreieck commented on 2024-03-25 23:01 (UTC)

Can you please move the go download stuff out of build() and into prepare(), so that build() can take place in an offline environment?: 

==> Starting build()...
go: downloading github.com/pdevine/tensor v0.0.0-20240228013915-64ccaa8d9ca9
go: downloading github.com/x448/float16 v0.8.4
go: downloading golang.org/x/exp v0.0.0-20230817173708-d852ddb80c63
go: downloading golang.org/x/sync v0.3.0
go: downloading github.com/d4l3k/go-bfloat16 v0.0.0-20211005043715-690c3bdd05f1
go: downloading github.com/gin-gonic/gin v1.9.1
go: downloading golang.org/x/term v0.13.0
go: downloading github.com/emirpasic/gods v1.18.1
go: downloading github.com/gin-contrib/cors v1.4.0
[...]

Regards and thanks for maintaining!

dreieck commented on 2024-03-25 23:00 (UTC)

pkgver() needs fixes: 

==> ERROR: pkgver is not allowed to contain colons, forward slashes, hyphens or whitespace.
==> ERROR: pkgver() generated an invalid version: 0.1.30-rc1.gc2712b55

(I added | tr '-' '.' to fix this.)

Regards and thanks for maintaining!

sr.team commented on 2024-03-22 13:00 (UTC)

@intersectRaven thank you for bringing this to your attention. I override CFLAGS and CXXFLAGS now

« First ‹ Previous 1 2 3 4 Next › Last »