Package Details: llama.cpp-cuda b9305-1

Git Clone URL: https://aur.archlinux.org/llama.cpp-cuda.git (read-only, click to copy)
Package Base: llama.cpp-cuda
Description: Port of Facebook's LLaMA model in C/C++ (with NVIDIA CUDA optimizations)
Upstream URL: https://github.com/ggml-org/llama.cpp
Licenses: MIT
Conflicts: ggml, libggml, llama.cpp
Provides: llama.cpp
Submitter: txtsd
Maintainer: fabse
Last Packager: fabse
Votes: 17
Popularity: 1.77
First Submitted: 2024-10-26 20:17 (UTC)
Last Updated: 2026-05-24 12:33 (UTC)

Dependencies (18)

Required by (5)

Sources (3)

Pinned Comments

txtsd commented on 2024-10-26 20:17 (UTC) (edited on 2024-12-06 14:15 (UTC) by txtsd)

Alternate versions

llama.cpp
llama.cpp-vulkan
llama.cpp-sycl-fp16
llama.cpp-sycl-fp32
llama.cpp-cuda
llama.cpp-cuda-f16
llama.cpp-hip

Latest Comments

1 2 3 4 5 6 .. 10 Next › Last »

tuananh commented on 2026-05-24 15:01 (UTC)

Thank you @fabse

fabse commented on 2026-05-24 12:37 (UTC) (edited on 2026-05-24 13:06 (UTC) by fabse)

also, I noticed in the git-version of this package that cuda apparently doesn't compile natively by default? but it can be toggled like in this commit

I'm not using this package myself, but do ya all want that enabled?

fabse commented on 2026-05-24 12:33 (UTC)

sorry about the delay, I was waiting for this pr to be merged, which simplified building the webui, but now it should be working! lemme know if not otherwise :)

shafish commented on 2026-05-23 10:43 (UTC)

不想折腾UI问题的话直接用 llama.cpp-cuda-git 就好了

tuananh commented on 2026-05-22 15:26 (UTC)

web ui is broken. gotta add -DLLAMA_BUILD_WEBUI=ON

doaxan commented on 2026-05-20 12:30 (UTC)

Web UI is broken for b9245-1: https://github.com/ggml-org/llama.cpp/issues/23379 https://github.com/ggml-org/llama.cpp/issues/23105

fabse commented on 2026-05-07 18:51 (UTC)

oh right the config should be kept between installs, it will be included in the next release

alegru commented on 2026-05-07 14:47 (UTC)

Can you add backup=("etc/conf.d/llama.cpp") to PKGBUILD?

fabse commented on 2026-05-06 20:09 (UTC)

oh nice, thanks for letting me know, I can confirm the workaround is not needed anymore and is now removed (will be pushed here on the next release)

svenstaro commented on 2026-05-06 17:54 (UTC)

FYI gcc15 is now in [extra] and after re-sourcing your profile.d, $NVCC_CCBIN should correctly point to /usr/bin/g++-15 and all the CUDA stuff should just work.

1 2 3 4 5 6 .. 10 Next › Last »