Package Details: gpt4all-chat 3.2.1-1

Git Clone URL: https://aur.archlinux.org/gpt4all-chat.git (read-only, click to copy)
Package Base: gpt4all-chat
Description: run open-source LLMs anywhere
Upstream URL: https://gpt4all.io
Keywords: chatgpt gpt llm
Licenses: MIT
Submitter: ZhangHua
Maintainer: ZhangHua
Last Packager: ZhangHua
Votes: 8
Popularity: 0.96
First Submitted: 2023-11-22 05:47 (UTC)
Last Updated: 2024-08-14 03:04 (UTC)

Latest Comments

1 2 3 Next › Last »

ZhangHua commented on 2024-08-08 01:04 (UTC)

If I enable this, LocalDoc model will be installed into /usr/resources/nomic-embed-text-v1.5.f16.gguf, this is not a standard path to place package content.

You can see here for more info:

https://github.com/nomic-ai/gpt4all/blob/main/gpt4all-chat/embllm.cpp#L81

Maybe I have to modify its code to use a more standard place like /usr/share/gpt4all-chat/resources/nomic-embed-text-v1.5.f16.gguf. But archlinux do not like applying too many patches.

joeVinegar commented on 2024-08-07 14:21 (UTC) (edited on 2024-08-07 15:25 (UTC) by joeVinegar)

TL;DR: a model file included in the package is not found (not copied in the expected directory, it seems). as a consequence the LocalDoc feature doesn't work, the embedding stops at 0%

from console:

embllm WARNING: Local embedding model not found
WARNING: Could not load model for embeddings

CONTEXT: the recent versions of gpt4all-chat (from 3.0 I guess) have a LocalDoc functionality that make use of a local embedding model. According to devs on Nomic AI linux-help discord channel, this model is included in the package, the file name should be nomic-embed-text-v1.5.f16.guff In the flatpak directory it is in /var/lib/flatpak/app/io.gpt4all.gpt4all/...../files/resources

ZhangHua commented on 2024-07-03 13:11 (UTC) (edited on 2024-07-03 14:14 (UTC) by ZhangHua)

@AndyRTR I build this package with pkgctl build and it does have the problem you say. I think I may do more research on how to make pkgctl happy because I use makechrootpkg and it can build this PKGBUILD without problem.

But I must say this is not a zsh-only declare option, -r is supported by bash's declare command: https://www.gnu.org/software/bash/manual/html_node/Bash-Builtins.html

Edit: After I did some research, I found that the PKGBUILD is sourced when code is executed on the line 334 of /usr/share/devtools/lib/build/build.sh, and sourced again on the line 37 of /usr/share/devtools/lib/util/pacman.sh, which results that bash tries override a readonly variable and throws an error. Maybe this is pkgctl's problem?

AndyRTR commented on 2024-07-03 12:38 (UTC)

Please avoid using zsh-only declare options. Your PKGBUILD is not bash/sh compatible. See "man PKGBUILD". Please fix your package to allow for easy build for non-zsh users.

AndyRTR commented on 2024-06-09 07:44 (UTC)

Build fails in a clean chroot: PKGBUILD: line 19: _modules_name_map: readonly variable

ZhangHua commented on 2024-05-27 01:30 (UTC)

@javalsai No, cuda injects itself into your PATH environment variable. You can check here about that. If you are not hurry to use this package, I will split cuda and rocm support into other packages, just like what @raine says, so all you need to do is waiting for 2.8.0-3 is updated.

raine commented on 2024-05-26 22:43 (UTC)

Indeed, I mean different PKGBUILD. Yes, it is a bit more work, but I would say not too much since all PKGBUILDs are almost identical, and once you set them up, updating them is usually a simple change of the version number.

It is not unusual to have separate packages in such a situation, there are many "-cuda", "-rocm", "-mkl", ... packages, precisely for this reason.

javalsai commented on 2024-05-26 14:59 (UTC)

@ZhangHua what changes to environmental variables are you talking about? it's just a compilation flag right?

ZhangHua commented on 2024-05-26 14:03 (UTC)

@javalsai Maybe it is because that you need to logout and login to make cuda's changes to environment variables work. You can create this package in a clean chroot by running makechrootpkg or extra-x86_64-build, those commands are available in package devtools.

@raine If I use split packages which are still using same PKGBUILD, cuda and rocm still have to be installed. Maybe you mean upload cuda and rocm support in different PKGBUILDs? I think that will make PKGBUILDs hard to be maintained. What's more, package arrayfile is packaged by using cuda in makedepends and optdepends. But if you still think it is needed to split cuda and rocm into different PKGBUILDs, please let me know and I will do splitting job when I am free.

1 2 3 Next › Last »