Arch Linux User Repository

Search Criteria

Enter search criteria

Search by

Keywords

Out of Date

Sort by

Sort order

Per page

Package Details: koboldcpp-cuda 1.109.1-1

Package Actions

Git Clone URL:	https://aur.archlinux.org/koboldcpp-cuda.git (read-only, click to copy)
Package Base:	koboldcpp-cuda
Description:	An easy-to-use AI text-generation software for GGML and GGUF models (with CUDA)
Upstream URL:	https://github.com/LostRuins/koboldcpp
Keywords:	ai llm,
Licenses:	AGPL-3.0-only
Conflicts:	koboldcpp
Provides:	koboldcpp
Submitter:	alpindale
Maintainer:	TheBill2001
Last Packager:	TheBill2001
Votes:	7
Popularity:	0.073414
First Submitted:	2023-10-23 17:51 (UTC)
Last Updated:	2026-03-04 20:52 (UTC)

Dependencies (9)

cuda (cuda11.1^AUR, cuda-12.2^AUR, cuda12.0^AUR, cuda11.4^AUR, cuda-12.5^AUR, cuda-12.9^AUR, cuda-12.8^AUR, cuda-pascal^AUR)
python
vulkan-icd-loader (vulkan-icd-loader-git^AUR)
python-customtkinter^AUR (python-customtkinter-git^AUR, python-customtkinter^AUR) (optional) – for GUI launcher
python-darkdetect (optional) – for GUI launcher
python-jinja (optional) – jinja2 templates
python-psutil (optional) – increasing the process CPU priority
yad (yad-gtk2^AUR, yad-git^AUR, yad-light^AUR) (optional) – native file picker dialogs
zenity (zenity-gtk3^AUR, zenity-git^AUR, qarma-git^AUR, zenity-rs-bin^AUR) (optional) – native file picker dialogs

Required by (0)

Sources (3)

Pinned Comments

TheBill2001 commented on 2025-04-22 06:28 (UTC)

Portable/NoAVX2 build has been separated to koboldcpp-cuda-portable.

TheBill2001 commented on 2024-07-03 14:08 (UTC)

As of 1.69.1-3, I have added a desktop entry for GUI launcher, and you'll need to install customtkinter for it.

Latest Comments

1 2 3 Next › Last »

TheBill2001 commented on 2026-01-06 18:57 (UTC)

@medaminezghal Both gcc and make are dependencies of base-devel, which is required to run makepkg, which is required to build any PKGBUILD script. So those packages can safely be assumed to have been installed if one want to run makepkg.

medaminezghal commented on 2026-01-06 18:39 (UTC)

@TheBill2001 missing gcc and make for makedependencies.

zoeyrae commented on 2026-01-04 13:33 (UTC)

the latest update is a 404, it was pulled and replaced with koboldcpp-1.105.2

TheBill2001 commented on 2025-04-22 06:28 (UTC)

Portable/NoAVX2 build has been separated to koboldcpp-cuda-portable.

svenstaro commented on 2025-02-08 02:48 (UTC)

Would be great if you could include a hardened systemd unit file so that this is easy to run as a daemon.

JeanLucJ commented on 2024-12-12 14:51 (UTC) (edited on 2024-12-12 14:52 (UTC) by JeanLucJ)

I did a full system upgrade to be sure, to no avail.

I have exactly the same 15 errors, only the version of gcc is newer (14.2.1, 14.1.1 in the post I found). I am aware it's for whisper.cpp, but the root cause (incompatibility between nvcc and gcc) seems generic enough.

/usr/include/c++/14.2.1/x86_64-pc-linux-gnu/bits/c++config.h(827): error: user-defined literal operator not found typedef __decltype(0.0bf16) __bfloat16_t; ^

Don't bother if it's working for you. There is a problem on my part for some reason

TheBill2001 commented on 2024-12-12 14:27 (UTC)

@JeanLucJ What is the error exactly? I cannot reproduce it on my machine. That GitHub issue is also for whisper.cpp not llama.cpp and several months old. Try update Arch, perhaps.

JeanLucJ commented on 2024-12-12 14:12 (UTC)

Hello,

Compilation fails. Possible fix here : https://github.com/ggerganov/whisper.cpp/issues/2250

TheBill2001 commented on 2024-11-01 21:27 (UTC)

@h0ru5 I have added the option to disable portable build. I have meant to do this for a while but didn't get around to do it.

1 2 3 Next › Last »