Package Details: koboldcpp-bin 1.63-1

Git Clone URL: https://aur.archlinux.org/koboldcpp-bin.git (read-only, click to copy)
Package Base: koboldcpp-bin
Description: A simple one-file way to run various GGML and GGUF models with KoboldAI's UI. (Requires AVX2 support)
Upstream URL: https://github.com/LostRuins/koboldcpp
Keywords: ai ggml gguf koboldcpp
Licenses: AGPL3
Conflicts: koboldcpp
Provides: koboldcpp
Submitter: speedorama
Maintainer: speedorama
Last Packager: speedorama
Votes: 1
Popularity: 0.199694
First Submitted: 2024-01-14 00:25 (UTC)
Last Updated: 2024-04-20 04:16 (UTC)

Latest Comments

speedorama commented on 2024-04-09 14:00 (UTC)

@dreieck Those changes have been made. Thanks for the feedback!

dreieck commented on 2024-03-27 10:31 (UTC)

Please add koboldcpp=${pkgver} to the provides array and koboldcpp to the conflicts array.

Regards and thanks for maintaining!

speedorama commented on 2024-02-18 22:46 (UTC) (edited on 2024-02-18 23:40 (UTC) by speedorama)

@snarfies Please direct issues to koboldcpp's GitHub repository, as the binary is taken directly from it.

If you would like to build from source instead (this would solve the tkinter issue, not sure about horde), it wouldn't be hard to modify koboldcpp-cuda's existing PKGBUILD to use the latest release. Below is a PKGBUILD demonstrating that.

pkgname=koboldcpp-cuda
pkgver=1.58
pkgrel=1
pkgdesc="CUDA build of koboldcpp"
arch=('x86_64')
url="https://github.com/LostRuins/koboldcpp"
license=('AGPL3')
depends=('python' 'cblas' 'openblas' 'cuda')
optdepends=('customtkinter')
source=("$pkgname-$pkgver.tar.gz::https://github.com/LostRuins/koboldcpp/archive/refs/tags/v$pkgver.tar.gz")
md5sums=('6d51ad5f6afaa7112d97302787d03ab0')

build() {
  cd "$srcdir/koboldcpp-$pkgver"
  make LLAMA_OPENBLAS=1 LLAMA_FAST=1 LLAMA_CUBLAS=1
}

package() {
  cd "$srcdir/koboldcpp-$pkgver"

  install -d "$pkgdir/usr/share/koboldcpp"
  cp -a . "$pkgdir/usr/share/koboldcpp"

  echo '#!/bin/sh' > koboldcpp
  echo 'cd /usr/share/koboldcpp && python koboldcpp.py "$@"' >> koboldcpp

  install -Dm755 koboldcpp "$pkgdir/usr/bin/koboldcpp"
}

Edit:

Concerning the ugly UI, tkinter is detected, as if it weren't, there wouldn't be a UI. I've been told that there's an issue with a conflicting or missing X11 dependency, and no solution is known yet.

For Horde, you can also try exporting the SSL certificate directory, like so:

$ export SSL_CERT_DIR=/etc/ssl/certs

toynbeeidea commented on 2024-02-18 13:13 (UTC)

Still not fully functioning as of 1.58 update: tkinter is still not being detected/used, still unable to connect to Kobold Horde.

toynbeeidea commented on 2024-02-14 05:31 (UTC) (edited on 2024-02-14 13:09 (UTC) by toynbeeidea)

Two issues with the -bin build as opposed to the outdated kobolcpp-cuda:

1) tkinter does not seem to be detected, despite being installed. Minor issue, just makes the GUI ugly.

2) Cannot connect to Kobold Horde: Please connect to custom endpoint at http://localhost:5001 [00:26:58] Embedded Horde Worker 'test' is started. [00:26:58] Error: <urlopen error [SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed (_ssl.c:1131)> - Make sure your Horde API key and worker name is valid!