Package Details: koboldcpp 1.93.2-1

Git Clone URL: https://aur.archlinux.org/koboldcpp.git (read-only, click to copy)
Package Base: koboldcpp
Description: An easy-to-use AI text-generation software for GGML and GGUF models
Upstream URL: https://github.com/LostRuins/koboldcpp
Licenses: AGPL-3.0-only
Submitter: TheBill2001
Maintainer: TheBill2001
Last Packager: TheBill2001
Votes: 4
Popularity: 0.013146
First Submitted: 2024-03-20 11:48 (UTC)
Last Updated: 2025-06-11 09:05 (UTC)

Dependencies (8)

Required by (0)

Sources (3)

Pinned Comments

TheBill2001 commented on 2025-04-22 06:27 (UTC) (edited on 2025-04-22 06:27 (UTC) by TheBill2001)

Portable/NoAVX2 build has been separated to koboldcpp-portable.

TheBill2001 commented on 2024-07-03 14:08 (UTC)

As of 1.69.1-3, I have added a desktop entry for GUI launcher, and you'll need to install customtkinter for it.

Latest Comments

1 2 Next › Last »

ap_qld commented on 2025-05-25 23:58 (UTC) (edited on 2025-05-26 14:22 (UTC) by ap_qld)

Works after installing python-customtkinter - could you please change this to be a required dependency and not optional? Cheers, otherwise, the following error appears:

Reason: No module named 'customtkinter' File selection GUI unsuported. ...

TheBill2001 commented on 2025-04-22 06:27 (UTC) (edited on 2025-04-22 06:27 (UTC) by TheBill2001)

Portable/NoAVX2 build has been separated to koboldcpp-portable.

TheBill2001 commented on 2025-01-15 08:17 (UTC)

@IrreleventIdiot Unsure. Check your Python environment. Make sure to that KoboldCpp and python-customtkinter are installed within the same python environment. In this case, that would be your global system environment (without any virtual environment).

However, KoboldCpp can run without the launcher. In the console, use --skiplauncher to skip the launcher. You just need to manually set the arguments. Use -h to see what is available.

IrreleventIdiot commented on 2025-01-14 03:33 (UTC)

GUI failed to start: Reason: No module named 'customtkinter'

I made sure both tk (arch extra) and python-customtkinter (aur) are installed, so not sure why gui won't launch.

TheBill2001 commented on 2024-11-02 23:49 (UTC)

@dreieck Fixed.

dreieck commented on 2024-11-02 22:46 (UTC)

This no longer works since it expects a file ~/.config/koboldcpp_build.conf which must not be assumed to be present for the package building user:

==> Starting build()...
/var/cache/yay/koboldcpp/PKGBUILD: line 45: /home/<censored>/.config/koboldcpp_build.conf: No such file or directory

Please fix, and include in the package recipe a reasonable build config.

Regards!

TheBill2001 commented on 2024-11-01 21:21 (UTC) (edited on 2024-11-01 21:24 (UTC) by TheBill2001)

Build configuration could be changed with environment variables.

Or set via KEY=VALUE in ${XDG_CONFIG_HOME}/koboldcpp_build.conf file (default is ~/.config/koboldcpp_build.conf).


KOBOLDCPP_NO_PORTABLE - Disabling portable build (including failsafe and noavx2):

  • '0' - Keep portable build enabled (default)
  • '1' or any other value that isn't '0' - Disable portable build.

TheBill2001 commented on 2024-07-03 14:08 (UTC)

As of 1.69.1-3, I have added a desktop entry for GUI launcher, and you'll need to install customtkinter for it.

TheBill2001 commented on 2024-04-21 19:36 (UTC)

@chalanov Failsafe and NoAVX2 need to set LLAMA_PORTABLE=1. I have updated it.

chalanov commented on 2024-04-21 18:35 (UTC) (edited on 2024-04-21 18:37 (UTC) by chalanov)

Can you change pkgbuild to support older processors? I tried the CLBlast NoAVX2 version and it worked well. AVX2 remains supported. My changes:


# build function (NOAVX2_BUILD)
make LLAMA_VULKAN=1 LLAMA_OPENBLAS=1 LLAMA_CLBLAST=1 NOAVX2_BUILD=true

# package function
install -Dm644 "koboldcpp_clblast_noavx2.so" "$pkgdir/usr/share/koboldcpp/koboldcpp_clblast_noavx2.so"
install -Dm644 "koboldcpp_vulkan_noavx2.so" "$pkgdir/usr/share/koboldcpp/koboldcpp_vulkan_noavx2.so"

# I also try FAILSAFE_BUILD=true, but so files not created

1 2 Next › Last »