| Git Clone URL: | https://aur.archlinux.org/ollama-rocm-git.git (read-only, click to copy) |
|---|---|
| Package Base: | ollama-rocm-git |
| Description: | Create, run and share large language models (LLMs) with ROCm |
| Upstream URL: | https://github.com/ollama/ollama |
| Licenses: | MIT |
| Conflicts: | ollama |
| Provides: | ollama |
| Submitter: | sr.team |
| Maintainer: | wgottwalt |
| Last Packager: | wgottwalt |
| Votes: | 4 |
| Popularity: | 0.55 |
| First Submitted: | 2024-02-28 00:40 (UTC) |
| Last Updated: | 2024-12-17 06:59 (UTC) |
pkgver() needs fixes:
==> ERROR: pkgver is not allowed to contain colons, forward slashes, hyphens or whitespace.
==> ERROR: pkgver() generated an invalid version: 0.1.30-rc1.gc2712b55
(I added | tr '-' '.' to fix this.)
Regards and thanks for maintaining!
@intersectRaven thank you for bringing this to your attention. I override CFLAGS and CXXFLAGS now
A recent pacman update added new arguments to CFLAGS so directly putting a '#' on the line will cause errors. Maybe we should override the CFLAGS in the PKGBUILD itself so this can be better avoided in the future?
@agilob it's a '-git' package. Version updates automatically during installation process
Hi, I cannot build this package due to the following error:
error: option 'cf-protection=return' cannot be specified on this target
error: option 'cf-protection=branch' cannot be specified on this target
192 warnings and 2 errors generated when compiling for gfx1010.
make[3]: *** [CMakeFiles/ggml.dir/build.make:132: CMakeFiles/ggml.dir/ggml-cuda.cu.o] Error 1
make[3]: *** Waiting for unfinished jobs....
make[2]: *** [CMakeFiles/Makefile2:742: CMakeFiles/ggml.dir/all] Error 2
make[1]: *** [CMakeFiles/Makefile2:2906: examples/server/CMakeFiles/ext_server.dir/rule] Error 2
make: *** [Makefile:1193: ext_server] Error 2
llm/generate/generate_linux.go:3: running "bash": exit status 2
==> ERROR: A failure occurred in build().
Even with the pinned changes, the build is failing for me with:
CMake Error at /usr/share/cmake/Modules/CMakeTestCCompiler.cmake:67 (message):
The C compiler
"/usr/bin/cc"
is not able to compile a simple test program.
It fails with the following output:
Change Dir: '/home/lindenk/.cache/yay/ollama-rocm-git/src/ollama/llm/llama.cpp/build/linux/x86_64/cpu/CMakeFiles/CMakeScratch/TryCompile-den2H4'
Run Build Command(s): /usr/bin/cmake -E env VERBOSE=1 /usr/bin/make -f Makefile cmTC_5cbab/fast
/usr/bin/make -f CMakeFiles/cmTC_5cbab.dir/build.make CMakeFiles/cmTC_5cbab.dir/build
make[1]: Entering directory '/home/lindenk/.cache/yay/ollama-rocm-git/src/ollama/llm/llama.cpp/build/linux/x86_64/cpu/CMakeFiles/CMakeScratch/TryCompile-den2H4'
Building C object CMakeFiles/cmTC_5cbab.dir/testCCompiler.c.o
/usr/bin/cc -march=x86-64 -mtune=generic -O2 -pipe -fno-plt -fexceptions -Wp,-D_FORTIFY_SOURCE=2 -Wformat -Werror=format-security # -fstack-clash-protection -fcf-protection -g -ffile-prefix-map=/home/lindenk/.cache/yay/ollama-rocm-git/src=/usr/src/debug/ollama-rocm-git -flto=auto -fPIE -o CMakeFiles/cmTC_5cbab.dir/testCCompiler.c.o -c /home/lindenk/.cache/yay/ollama-rocm-git/src/ollama/llm/llama.cpp/build/linux/x86_64/cpu/CMakeFiles/CMakeScratch/TryCompile-den2H4/testCCompiler.c
cc: fatal error: no input files
compilation terminated.
make[1]: *** [CMakeFiles/cmTC_5cbab.dir/build.make:78: CMakeFiles/cmTC_5cbab.dir/testCCompiler.c.o] Error 1
make[1]: Leaving directory '/home/lindenk/.cache/yay/ollama-rocm-git/src/ollama/llm/llama.cpp/build/linux/x86_64/cpu/CMakeFiles/CMakeScratch/TryCompile-den2H4'
make: *** [Makefile:127: cmTC_5cbab/fast] Error 2
CMake will not be able to correctly generate this project.
Call Stack (most recent call first):
CMakeLists.txt:2 (project)
Same compile error of @nameiwillforget, fixed using the @bullet92 workaround commenting the line in /etc/makepkg.conf
45 # -fstack-clash-protection -fcf-protection
Hi, without the package hipblas it does not install with the following compilation error:
CMake Error at CMakeLists.txt:500 (find_package):
By not providing "Findhipblas.cmake" in CMAKE_MODULE_PATH this project has
asked CMake to find a package configuration file provided by "hipblas", but
CMake did not find one.
Could not find a package configuration file provided by "hipblas" with any
of the following names:
hipblasConfig.cmake
hipblas-config.cmake
Add the installation prefix of "hipblas" to CMAKE_PREFIX_PATH or set
"hipblas_DIR" to a directory containing one of the above files. If
"hipblas" provides a separate development package or SDK, be sure it has
been installed.
Suggestion: add hipblas as dependencies
In any case compile fail, so I have to modify my /etc/makepkg.conf and commented out this line:
45 # -fstack-clash-protection -fcf-protection
After starting ollama with systemctl and checking the output with status I obtained:
level=INFO source=routes.go:1044 msg="no GPU detected"
So I edited the service adding "HSA_OVERRIDE_GFX_VERSION=10.3.0" to the current environment in ollama.service
sudo systemctl edit ollama.service
[Service]
Environment="HOME=/var/lib/ollama" "GIN_MODE=release" "HSA_OVERRIDE_GFX_VERSION=10.3.0"
and installed some dependencies:
pacman -S rocm-hip-sdk rocm-opencl-sdk clblast go
( in my case rocm-hip-sdk rocm-opencl-sdk were missings ) And that gives me "Radeon GPU detected"
@nameiwillforget you can build ROCm version in docker, without a CUDA
Pinned Comments
wgottwalt commented on 2024-11-09 10:46 (UTC) (edited on 2024-11-26 15:23 (UTC) by wgottwalt)
Looks like the ROCm 6.2.2-1 SDK has a malfunctioning compiler. It produces a broken ollama binary (fp16 issues). You may need to stay with ROCm 6.0.2 for now. I don't know if this got fixed in a newer build release. But the initial SDK version "-1" is broken.
ROCm 6.2.4 fixes this issue completely.