Package Details: localai-git-cuda 2.12.3.112.g9dbd217c-1

Git Clone URL: https://aur.archlinux.org/localai-git.git (read-only, click to copy)
Package Base: localai-git
Description: Self-hosted OpenAI API alternative - Open Source, community-driven and local-first. (with CUDA support)
Upstream URL: https://github.com/mudler/LocalAI
Keywords: llm openai
Licenses: MIT
Conflicts: local-ai, localai
Provides: local-ai, localai
Submitter: wuxxin
Maintainer: wuxxin
Last Packager: wuxxin
Votes: 1
Popularity: 0.056718
First Submitted: 2023-11-28 17:08 (UTC)
Last Updated: 2024-04-24 22:31 (UTC)

Pinned Comments

wuxxin commented on 2023-11-28 17:10 (UTC)

Development is on Github: https://github.com/wuxxin/aur-packages Please open issues and PRs there instead of commenting.

Latest Comments

dreieck commented on 2024-04-03 07:35 (UTC)

I was building localai-git with _ENABLE_CUDA=0 _ENABLE_ROCM=1 _ENABLE_CPU=1.

After finishing build, namcap tells me that the following packages miss the following dependencies:

  • localai-git-rocm:
  • rocblas,
  • hipblas: localai-git-rocm E: Dependency rocblas detected and not included (libraries ['opt/rocm/lib/librocblas.so.4'] needed in files ['usr/bin/local-ai']) localai-git-rocm E: Dependency hipblas detected and not included (libraries ['opt/rocm/lib/libhipblas.so.2'] needed in files ['usr/bin/local-ai'])
  • localai-git:
  • openblas:
    localai-git E: Dependency openblas detected and not included (libraries ['usr/lib/libopenblas.so.0'] needed in files ['usr/bin/local-ai'])

Also, you need to install the license into ${pkgdir}/usr/share/licenses/${pkgname}/:

E: Uncommon license identifiers such as 'MIT' require license files below /usr/share/licenses/localai-git/ or switching to common license identifiers. Found 0/1 required license files.

Regards and thanks for maintaining!

dreieck commented on 2024-04-03 07:34 (UTC)

in the PKGBUILD of localai-git you reference directories that are above $srcdir.

This must never be done. It is not guarantueed where this leads to, when the user has $SRCDEST set in /etc/makepkg.conf or the local environment.

This leads to an error in pkgver():

==> Starting pkgver()...
/tmp/makepkg/yay/localai-git/PKGBUILD: line 100: cd: /tmp/makepkg/build/localai-git/src/../localai: No such file or directory
==> ERROR: A failure occurred in pkgver().

Please replace "${srcdir}/../${_pkgname}" with "${srcdir}/${_pkgname}".

Regards and thanks for maintaining!

dreieck commented on 2024-04-03 07:34 (UTC)

Regarding git submodules, is it possible to follow Arch Linux guide on git submodules and download them via the source array and then only reference them in prepare()?

I.e. download the followint already via the source array?:

==> Starting prepare()...
[...]
make[1]: Entering directory '/tmp/makepkg/build/localai-git/src/localai/backend/cpp/llama'
git clone --recurse-submodules https://github.com/ggerganov/llama.cpp llama.cpp
Cloning into 'llama.cpp'...
[...]
Submodule 'kompute' (https://github.com/nomic-ai/kompute.git) registered for path 'kompute'
Cloning into '/tmp/makepkg/build/localai-git/src/localai/backend/cpp/llama/llama.cpp/kompute'...
[...]
make[1]: Leaving directory '/tmp/makepkg/build/localai-git/src/localai/backend/cpp/llama'
git clone --recurse-submodules https://github.com/mudler/go-piper sources/go-piper
Cloning into 'sources/go-piper'...
[...]
Cloning into '/tmp/makepkg/build/localai-git/src/localai/sources/go-piper/espeak'...
[...]
Cloning into '/tmp/makepkg/build/localai-git/src/localai/sources/go-piper/piper'...
[...]
Cloning into '/tmp/makepkg/build/localai-git/src/localai/sources/go-piper/piper-phonemize'...
[...]
Switched to a new branch 'build'
git clone https://github.com/ggerganov/whisper.cpp.git sources/whisper.cpp
Cloning into 'sources/whisper.cpp'...
[...]
Submodule 'bindings/ios' (https://github.com/ggerganov/whisper.spm) registered for path 'bindings/ios'
Cloning into '/tmp/makepkg/build/localai-git/src/localai/sources/whisper.cpp/bindings/ios'...
Submodule path 'bindings/ios': checked out 'b21b6ff32595d73694045f4c5568a0981096cbf7'
git clone --recurse-submodules https://github.com/go-skynet/go-bert.cpp sources/go-bert
Cloning into 'sources/go-bert'...
[...]
Submodule 'bert.cpp' (https://github.com/skeskinen/bert.cpp) registered for path 'bert.cpp'
Cloning into '/tmp/makepkg/build/localai-git/src/localai/sources/go-bert/bert.cpp'...
[...]
Submodule 'ggml' (https://github.com/ggerganov/ggml.git) registered for path 'bert.cpp/ggml'
Cloning into '/tmp/makepkg/build/localai-git/src/localai/sources/go-bert/bert.cpp/ggml'...
[...]
git clone --recurse-submodules https://github.com/M0Rf30/go-tiny-dream sources/go-tiny-dream
Cloning into 'sources/go-tiny-dream'...
[...]
Submodule 'tiny-dream' (https://github.com/symisc/tiny-dream) registered for path 'tiny-dream'
Cloning into '/tmp/makepkg/build/localai-git/src/localai/sources/go-tiny-dream/ncnn'...
[...]
Cloning into '/tmp/makepkg/build/localai-git/src/localai/sources/go-tiny-dream/tiny-dream'...
[...]
Submodule 'glslang' (https://github.com/KhronosGroup/glslang) registered for path 'ncnn/glslang'
Submodule 'python/pybind11' (https://github.com/pybind/pybind11.git) registered for path 'ncnn/python/pybind11'
Cloning into '/tmp/makepkg/build/localai-git/src/localai/sources/go-tiny-dream/ncnn/glslang'...
[...]
Cloning into '/tmp/makepkg/build/localai-git/src/localai/sources/go-tiny-dream/ncnn/python/pybind11'...
[...]

Regards and thanks for maintaining!

dreieck commented on 2024-04-03 07:34 (UTC)

Before this is solved, please also add local-ai=${pkgver} to the provides array and local-ai to the conflicts array.

Regards and thanks for maintaining!

dreieck commented on 2024-04-03 07:33 (UTC)

Please remove the leading v from ${pkgver} as required by the Arch Linux VCS package guidelines.

dreieck commented on 2024-03-26 07:33 (UTC) (edited on 2024-03-26 08:22 (UTC) by dreieck)

Here in the AUR are local-ai and local-ai-git.
The former is the release variant, the latter the -git-variant, of the same code.

But their "base" names differ (local-ai vs. localai).

Can you, both maintainers of the two packages, decide on a common package name and unify the naming, i.e. naming both localai and localai-git OR local-ai and local-ai-git?

(↗ Issue report in your github repository, as you request.)

Regards!

wuxxin commented on 2023-11-28 17:10 (UTC)

Development is on Github: https://github.com/wuxxin/aur-packages Please open issues and PRs there instead of commenting.