Arch Linux User Repository

Search Criteria

Enter search criteria

Search by

Keywords

Out of Date

Sort by

Sort order

Per page

Package Details: koboldcpp-cuda 1.78-1

Package Actions

Git Clone URL:	https://aur.archlinux.org/koboldcpp-cuda.git (read-only, click to copy)
Package Base:	koboldcpp-cuda
Description:	An easy-to-use AI text-generation software for GGML and GGUF models (with CUDA)
Upstream URL:	https://github.com/LostRuins/koboldcpp
Keywords:	ai llm,
Licenses:	AGPL-3.0-only
Conflicts:	koboldcpp
Provides:	koboldcpp
Submitter:	alpindale
Maintainer:	TheBill2001
Last Packager:	TheBill2001
Votes:	6
Popularity:	1.28
First Submitted:	2023-10-23 17:51 (UTC)
Last Updated:	2024-11-17 07:56 (UTC)

Dependencies (7)

cblas (blis-cblas-openmp^AUR, blis-cblas^AUR, aocl-blis-aocc^AUR, blas-git^AUR, atlas-lapack^AUR, blas-aocl-gcc^AUR, blas-aocl-aocc^AUR, blis-git^AUR, blis^AUR, openblas-lapack^AUR, blas-mkl^AUR, aocl-blis^AUR, blas-openblas)
clblast (clblast-git^AUR)
cuda (cuda11.1^AUR, cuda-12.2^AUR, cuda12.0^AUR, cuda11.4^AUR, cuda11.4-versioned^AUR, cuda12.0-versioned^AUR)
python (python37^AUR, python311^AUR, python310^AUR)
vulkan-icd-loader (vulkan-icd-loader-git^AUR)
python-customtkinter^AUR (python-customtkinter^AUR, python-customtkinter-git^AUR) (optional) – for GUI launcher
python-psutil (optional) – increasing the process CPU priority

Required by (0)

Sources (3)

Pinned Comments

TheBill2001 commented on 2024-11-01 21:26 (UTC)

Build configuration could be changed with environment variables.

Or set via KEY=VALUE in ${XDG_CONFIG_HOME}/koboldcpp_build.conf file (default is ~/.config/koboldcpp_build.conf).

KOBOLDCPP_NO_PORTABLE - Disabling portable build (including failsafe and noavx2):

'0' - Keep portable build enabled (default)
'1' or any other value that isn't '0' - Disable portable build.

TheBill2001 commented on 2024-07-03 14:08 (UTC)

As of 1.69.1-3, I have added a desktop entry for GUI launcher, and you'll need to install customtkinter for it.

Latest Comments

1 2 Next › Last »

TheBill2001 commented on 2024-11-01 21:27 (UTC)

@h0ru5 I have added the option to disable portable build. I have meant to do this for a while but didn't get around to do it.

TheBill2001 commented on 2024-11-01 21:26 (UTC)

Build configuration could be changed with environment variables.

Or set via KEY=VALUE in ${XDG_CONFIG_HOME}/koboldcpp_build.conf file (default is ~/.config/koboldcpp_build.conf).

KOBOLDCPP_NO_PORTABLE - Disabling portable build (including failsafe and noavx2):

'0' - Keep portable build enabled (default)
'1' or any other value that isn't '0' - Disable portable build.

h0ru5 commented on 2024-11-01 17:09 (UTC)

thanks for maintaining, saves a lot of work!

Is there a way to not build portable (making a config or dropping LLAMA_PORTABLE=1)? I explictly build it local to have -march=native and -mtune=native

people in need for portable ould rather use the -bin I guess?

TheBill2001 commented on 2024-07-03 14:08 (UTC)

As of 1.69.1-3, I have added a desktop entry for GUI launcher, and you'll need to install customtkinter for it.

dreieck commented on 2024-03-27 10:32 (UTC)

'koboldcpp-cuda' needs to be removed from the provides array, since this package is already named this.

Please add =${pkgver} to the koboldcpp-provides-entry.

dreieck commented on 2024-03-27 10:29 (UTC)

Please add koboldcpp to the conflicts array.

Regards and thanks for maintaining!

Mr.Smith1974 commented on 2024-03-20 11:09 (UTC)

thank you for adopting the package

TheBill2001 commented on 2024-03-19 09:35 (UTC)

@ilikenwf Install customtkinter will also install tk. It is only needed for the GUI launcher and is not needed for when running in CLI only. I have updated the optional dependency description.

TheBill2001 commented on 2024-03-19 09:30 (UTC)

I have adopted and updated the PKGBUILD to only install necessary files (rather than copying the whole source tree). Let me know if there is any problem.

1 2 Next › Last »