Arch Linux User Repository

Search Criteria

Enter search criteria

Search by

Keywords

Out of Date

Sort by

Sort order

Per page

Package Details: koboldcpp-cuda 1.89-1

Package Actions

Git Clone URL:	https://aur.archlinux.org/koboldcpp-cuda.git (read-only, click to copy)
Package Base:	koboldcpp-cuda
Description:	An easy-to-use AI text-generation software for GGML and GGUF models (with CUDA)
Upstream URL:	https://github.com/LostRuins/koboldcpp
Keywords:	ai llm,
Licenses:	AGPL-3.0-only
Conflicts:	koboldcpp
Provides:	koboldcpp
Submitter:	alpindale
Maintainer:	TheBill2001
Last Packager:	TheBill2001
Votes:	6
Popularity:	0.049999
First Submitted:	2023-10-23 17:51 (UTC)
Last Updated:	2025-04-22 06:25 (UTC)

Dependencies (9)

cblas (blis-cblas-openmp^AUR, blis-cblas^AUR, aocl-blis-aocc^AUR, blas-git^AUR, atlas-lapack^AUR, blas-aocl-gcc^AUR, blas-aocl-aocc^AUR, blis-git^AUR, blis^AUR, blas-mkl^AUR, aocl-blis^AUR, openblas-lapack^AUR, blas-openblas)
clblast (clblast-git^AUR)
cuda (cuda11.1^AUR, cuda-12.2^AUR, cuda12.0^AUR, cuda11.4^AUR, cuda11.4-versioned^AUR, cuda12.0-versioned^AUR)
python (python37^AUR, python311^AUR, python310^AUR)
vulkan-icd-loader (vulkan-icd-loader-git^AUR)
python-customtkinter^AUR (python-customtkinter^AUR, python-customtkinter-git^AUR) (optional) – for GUI launcher
python-psutil (optional) – increasing the process CPU priority
yad (yad-gtk2^AUR, yad-git^AUR) (optional) – native file picker dialogs
zenity (zenity-gtk3^AUR, zenity-git^AUR, qarma-git^AUR) (optional) – native file picker dialogs

Required by (0)

Sources (3)

Pinned Comments

TheBill2001 commented on 2025-04-22 06:28 (UTC)

Portable/NoAVX2 build has been separated to koboldcpp-cuda-portable.

TheBill2001 commented on 2024-07-03 14:08 (UTC)

As of 1.69.1-3, I have added a desktop entry for GUI launcher, and you'll need to install customtkinter for it.

Latest Comments

1 2 Next › Last »

TheBill2001 commented on 2025-04-22 06:28 (UTC)

Portable/NoAVX2 build has been separated to koboldcpp-cuda-portable.

svenstaro commented on 2025-02-08 02:48 (UTC)

Would be great if you could include a hardened systemd unit file so that this is easy to run as a daemon.

JeanLucJ commented on 2024-12-12 14:51 (UTC) (edited on 2024-12-12 14:52 (UTC) by JeanLucJ)

I did a full system upgrade to be sure, to no avail.

I have exactly the same 15 errors, only the version of gcc is newer (14.2.1, 14.1.1 in the post I found). I am aware it's for whisper.cpp, but the root cause (incompatibility between nvcc and gcc) seems generic enough.

/usr/include/c++/14.2.1/x86_64-pc-linux-gnu/bits/c++config.h(827): error: user-defined literal operator not found typedef __decltype(0.0bf16) __bfloat16_t; ^

Don't bother if it's working for you. There is a problem on my part for some reason

TheBill2001 commented on 2024-12-12 14:27 (UTC)

@JeanLucJ What is the error exactly? I cannot reproduce it on my machine. That GitHub issue is also for whisper.cpp not llama.cpp and several months old. Try update Arch, perhaps.

JeanLucJ commented on 2024-12-12 14:12 (UTC)

Hello,

Compilation fails. Possible fix here : https://github.com/ggerganov/whisper.cpp/issues/2250

TheBill2001 commented on 2024-11-01 21:27 (UTC)

@h0ru5 I have added the option to disable portable build. I have meant to do this for a while but didn't get around to do it.

TheBill2001 commented on 2024-11-01 21:26 (UTC)

Build configuration could be changed with environment variables.

Or set via KEY=VALUE in ${XDG_CONFIG_HOME}/koboldcpp_build.conf file (default is ~/.config/koboldcpp_build.conf).

KOBOLDCPP_NO_PORTABLE - Disabling portable build (including failsafe and noavx2):

'0' - Keep portable build enabled (default)
'1' or any other value that isn't '0' - Disable portable build.

h0ru5 commented on 2024-11-01 17:09 (UTC)

thanks for maintaining, saves a lot of work!

Is there a way to not build portable (making a config or dropping LLAMA_PORTABLE=1)? I explictly build it local to have -march=native and -mtune=native

people in need for portable ould rather use the -bin I guess?

1 2 Next › Last »