@graysky, this is using CUDA as provided by dependencies, namely libggml-cuda-git or llama.cpp.cuda-git, not by itself, so it remains compatible with other tools a user might be using, and the user is not needing to compile again something that already exists on the system.
So yes, it is actually building the CUDA flavour, but in a way that plays nice with other installed packages.
Note the flag you've enabled:
build -DGGML_CUDA=1
And note what is already explicitly specified as a dependency:
libggml-cuda-git
So you can force this package to build GGML_CUDA, but it is redundant and may even conflict, as it will also be building that as part of libggml-cuda-git or llama.cpp-cuda-git.
Pinned Comments
Bink commented on 2026-05-04 02:39 (UTC) (edited on 2026-05-17 23:08 (UTC) by Bink)
If you're having trouble installing this because of build failure in
libggml-cuda-git, I suggest first installingllama.cpp-cuda-gitwhich also satisfies thelibggml-cuda-gitdependency, and is not failing to build.