Wait can you show me individual file sizes? That's not right.
Search Criteria
Package Details: llama.cpp-cuda b10078-1
Package Actions
| Git Clone URL: | https://aur.archlinux.org/llama.cpp-cuda.git (read-only, click to copy) |
|---|---|
| Package Base: | llama.cpp-cuda |
| Description: | Port of Facebook's LLaMA model in C/C++ (with NVIDIA CUDA optimizations) |
| Upstream URL: | https://github.com/ggml-org/llama.cpp |
| Licenses: | MIT |
| Conflicts: | ggml, libggml, llama.cpp |
| Provides: | llama.cpp |
| Submitter: | txtsd |
| Maintainer: | fabse |
| Last Packager: | fabse |
| Votes: | 22 |
| Popularity: | 3.10 |
| First Submitted: | 2024-10-26 20:17 (UTC) |
| Last Updated: | 2026-07-21 23:45 (UTC) |
Dependencies (19)
- cuda (cuda11.1AUR, cuda-12.2AUR, cuda12.0AUR, cuda11.4AUR, cuda-12.5AUR, cuda-12.8AUR, cuda-pascalAUR, cuda-12.9AUR)
- curl (curl-gitAUR, curl-c-aresAUR)
- gcc-libs (gcc-libs-gitAUR, gcc-libs-fast-optimizedAUR, gccrs-libs-gitAUR, gcc-libs-snapshotAUR)
- glibc (glibc-gitAUR, glibc-git-native-pgoAUR, glibc-eacAUR)
- nvidia-utils (nvidia-410xx-utilsAUR, nvidia-440xx-utilsAUR, nvidia-430xx-utilsAUR, nvidia-340xx-utilsAUR, nvidia-510xx-utilsAUR, nvidia-utils-teslaAUR, nvidia-575xx-utilsAUR, nvidia-340xx-utils-macbookAUR, nvidia-535xx-utilsAUR, nvidia-470xx-utilsAUR, nvidia-390xx-utilsAUR, nvidia-550xx-utilsAUR, nvidia-525xx-utilsAUR, nvidia-580xx-utilsAUR, nvidia-vulkan-utilsAUR, nvidia-utils-betaAUR)
- python
- cmake (cmake3AUR, cmake-gitAUR) (make)
- cudnn (cudnn9.10-cuda12.9AUR, cudnn-pascalAUR) (make)
- git (git-gitAUR, git-glAUR, git-wd40AUR) (make)
- ninja (ninja-gitAUR, ninja-memAUR, ninja-noemacs-gitAUR, ninja-kitwareAUR, ninja-fuchsia-gitAUR, n2-gitAUR) (make)
- npm (npm-corepackAUR, python-nodejs-wheelAUR) (make)
- shaderc (shaderc-gitAUR, shaderc-gitAUR) (make)
- nccl (nccl-gitAUR, nccl-cuda12.9AUR) (optional) – needed for multi-GPU parallelism
- python-ggufAUR (python-gguf-gitAUR) (optional) – needed for convert_hf_to_gguf.py
- python-numpy (python-numpy-gitAUR, python-numpy-mkl-binAUR, python-numpy1AUR, python-numpy-mkl-tbbAUR, python-numpy-mklAUR) (optional) – needed for convert_hf_to_gguf.py
- python-pytorch (python-pytorch-cuda12.9AUR, python-pytorch-opt-cuda12.9AUR, python-pytorch-cuda, python-pytorch-opt, python-pytorch-opt-cuda, python-pytorch-opt-rocm, python-pytorch-opt-xpu, python-pytorch-rocm, python-pytorch-xpu) (optional) – needed for convert_hf_to_gguf.py
- python-safetensors (optional) – needed for convert_hf_to_gguf.py
- python-sentencepieceAUR (python-sentencepiece-gitAUR, python-sentencepiece-binAUR) (optional) – needed for convert_hf_to_gguf.py
- python-transformersAUR (python-transformers-gitAUR) (optional) – needed for convert_hf_to_gguf.py
Required by (13)
- assistd (requires llama.cpp) (optional)
- assistd-git (requires llama.cpp) (optional)
- llamaman-bin (requires llama.cpp) (optional)
- llamastash (requires llama.cpp) (optional)
- llamastash-bin (requires llama.cpp) (optional)
- llamastash-git (requires llama.cpp) (optional)
- manboster (requires llama.cpp) (optional)
- manboster-bin (requires llama.cpp) (optional)
- manboster-git (requires llama.cpp) (optional)
- scmd-bin (requires llama.cpp)
- voxd (requires llama.cpp) (optional)
- voxd-bin (requires llama.cpp) (optional)
- voxd-git (requires llama.cpp) (optional)
Sources (3)
txtsd commented on 2024-11-15 10:19 (UTC)
txtsd commented on 2024-11-15 10:18 (UTC)
@brauliobo Such is life with CUDA :( I can't even build this on my CI because of the size requirements
brauliobo commented on 2024-11-15 10:17 (UTC)
the build is taking 45gb! just the build/bin folder takes 38gb:
braulio @ whitebeast ➜ bin git:(master) pwd
/home/braulio/.cache/yay/llama.cpp-cuda/src/build/bin
braulio @ whitebeast ➜ bin git:(master) du -h --max-depth=1
38G .
braulio @ whitebeast ➜ bin git:(master) ls
llama-batched llama-gbnf-validator llama-lookup llama-quantize llama-vdot test-grammar-integration test-sampling
llama-batched-bench llama-gguf llama-lookup-create llama-quantize-stats rpc-server test-grammar-parser test-tokenizer-0
llama-bench llama-gguf-hash llama-lookup-merge llama-retrieval test-arg-parser test-json-schema-to-grammar test-tokenizer-1-bpe
llama-cli llama-gguf-split llama-lookup-stats llama-save-load-state test-autorelease test-llama-grammar test-tokenizer-1-spm
llama-convert-llama2c-to-ggml llama-gritlm llama-minicpmv-cli llama-server test-backend-ops test-log
llama-cvector-generator llama-imatrix llama-parallel llama-simple test-barrier test-model-load-cancel
llama-embedding llama-infill llama-passkey llama-simple-chat test-c test-quantize-fns
llama-eval-callback llama-llava-cli llama-perplexity llama-speculative test-chat-template test-quantize-perf
llama-export-lora llama-lookahead llama-q8dot llama-tokenize test-grad0 test-rope
Pinned Comments
txtsd commented on 2024-10-26 20:17 (UTC) (edited on 2024-12-06 14:15 (UTC) by txtsd)
Alternate versions
llama.cpp
llama.cpp-vulkan
llama.cpp-sycl-fp16
llama.cpp-sycl-fp32
llama.cpp-cuda
llama.cpp-cuda-f16
llama.cpp-hip