Package Details: koboldcpp 1.63-3

Git Clone URL: https://aur.archlinux.org/koboldcpp.git (read-only, click to copy)
Package Base: koboldcpp
Description: An easy-to-use AI text-generation software for GGML and GGUF models
Upstream URL: https://github.com/LostRuins/koboldcpp
Licenses: AGPL-3.0-only
Submitter: TheBill2001
Maintainer: TheBill2001
Last Packager: TheBill2001
Votes: 2
Popularity: 1.53
First Submitted: 2024-03-20 11:48 (UTC)
Last Updated: 2024-04-25 12:17 (UTC)

Dependencies (7)

Required by (0)

Sources (1)

Latest Comments

TheBill2001 commented on 2024-04-21 19:36 (UTC)

@chalanov Failsafe and NoAVX2 need to set LLAMA_PORTABLE=1. I have updated it.

chalanov commented on 2024-04-21 18:35 (UTC) (edited on 2024-04-21 18:37 (UTC) by chalanov)

Can you change pkgbuild to support older processors? I tried the CLBlast NoAVX2 version and it worked well. AVX2 remains supported. My changes:


# build function (NOAVX2_BUILD)
make LLAMA_VULKAN=1 LLAMA_OPENBLAS=1 LLAMA_CLBLAST=1 NOAVX2_BUILD=true

# package function
install -Dm644 "koboldcpp_clblast_noavx2.so" "$pkgdir/usr/share/koboldcpp/koboldcpp_clblast_noavx2.so"
install -Dm644 "koboldcpp_vulkan_noavx2.so" "$pkgdir/usr/share/koboldcpp/koboldcpp_vulkan_noavx2.so"

# I also try FAILSAFE_BUILD=true, but so files not created

dreieck commented on 2024-03-27 10:28 (UTC)

Ahoj,

  • python-psutil seems to be needed as dependency,
  • Licens identifier needs to be modified to be SPDX comliant.

From namcap: 

koboldcpp E: AGPL3 is not a valid SPDX license identifier. See https://spdx.org/licenses/ for valid identifiers, or prefix the identifier with 'LicenseRef-', if it is custom.
koboldcpp E: Dependency python-psutil detected and not included (python modules ['psutil'] needed in files ['usr/share/koboldcpp/koboldcpp.py'])

Regards!