Package Details: koboldcpp-cuda 1.87-1

Git Clone URL: https://aur.archlinux.org/koboldcpp-cuda.git (read-only, click to copy)
Package Base: koboldcpp-cuda
Description: An easy-to-use AI text-generation software for GGML and GGUF models (with CUDA)
Upstream URL: https://github.com/LostRuins/koboldcpp
Keywords: ai llm,
Licenses: AGPL-3.0-only
Conflicts: koboldcpp
Provides: koboldcpp
Submitter: alpindale
Maintainer: TheBill2001
Last Packager: TheBill2001
Votes: 6
Popularity: 0.075232
First Submitted: 2023-10-23 17:51 (UTC)
Last Updated: 2025-04-01 14:43 (UTC)

Pinned Comments

TheBill2001 commented on 2024-11-01 21:26 (UTC)

Build configuration could be changed with environment variables.

Or set via KEY=VALUE in ${XDG_CONFIG_HOME}/koboldcpp_build.conf file (default is ~/.config/koboldcpp_build.conf).


KOBOLDCPP_NO_PORTABLE - Disabling portable build (including failsafe and noavx2):

  • '0' - Keep portable build enabled (default)
  • '1' or any other value that isn't '0' - Disable portable build.

TheBill2001 commented on 2024-07-03 14:08 (UTC)

As of 1.69.1-3, I have added a desktop entry for GUI launcher, and you'll need to install customtkinter for it.

Latest Comments

1 2 Next › Last »

svenstaro commented on 2025-02-08 02:48 (UTC)

Would be great if you could include a hardened systemd unit file so that this is easy to run as a daemon.

JeanLucJ commented on 2024-12-12 14:51 (UTC) (edited on 2024-12-12 14:52 (UTC) by JeanLucJ)

I did a full system upgrade to be sure, to no avail.

I have exactly the same 15 errors, only the version of gcc is newer (14.2.1, 14.1.1 in the post I found). I am aware it's for whisper.cpp, but the root cause (incompatibility between nvcc and gcc) seems generic enough.

/usr/include/c++/14.2.1/x86_64-pc-linux-gnu/bits/c++config.h(827): error: user-defined literal operator not found typedef __decltype(0.0bf16) __bfloat16_t; ^

Don't bother if it's working for you. There is a problem on my part for some reason

TheBill2001 commented on 2024-12-12 14:27 (UTC)

@JeanLucJ What is the error exactly? I cannot reproduce it on my machine. That GitHub issue is also for whisper.cpp not llama.cpp and several months old. Try update Arch, perhaps.

JeanLucJ commented on 2024-12-12 14:12 (UTC)

Hello,

Compilation fails. Possible fix here : https://github.com/ggerganov/whisper.cpp/issues/2250

TheBill2001 commented on 2024-11-01 21:27 (UTC)

@h0ru5 I have added the option to disable portable build. I have meant to do this for a while but didn't get around to do it.

TheBill2001 commented on 2024-11-01 21:26 (UTC)

Build configuration could be changed with environment variables.

Or set via KEY=VALUE in ${XDG_CONFIG_HOME}/koboldcpp_build.conf file (default is ~/.config/koboldcpp_build.conf).


KOBOLDCPP_NO_PORTABLE - Disabling portable build (including failsafe and noavx2):

  • '0' - Keep portable build enabled (default)
  • '1' or any other value that isn't '0' - Disable portable build.

h0ru5 commented on 2024-11-01 17:09 (UTC)

thanks for maintaining, saves a lot of work!

Is there a way to not build portable (making a config or dropping LLAMA_PORTABLE=1)? I explictly build it local to have -march=native and -mtune=native

people in need for portable ould rather use the -bin I guess?

TheBill2001 commented on 2024-07-03 14:08 (UTC)

As of 1.69.1-3, I have added a desktop entry for GUI launcher, and you'll need to install customtkinter for it.

1 2 Next › Last »