Arch Linux User Repository

lemonade-server has a systemd service unit. Use systemctl start lemond to start.

Default configuration is available at /usr/share/lemonade/defaults.json and should be placed at: /var/lib/lemonade/.cache/lemonade/config.json

Also /etc/lemonade/conf.d/zz-secrets.conf for the Lemonade API KEY.

The cache where all models, backends, and other files are stored is now in /var/lib/lemonade/.cache

GUI: lemonade-desktop.

thanks @jackweeks3, a little bit of miscommunication, they had to release it again after I made the package. I will push a new version in a bit

FYI

==> Validating source files with sha256sums...
    lemonade-server-9.1.4.tar.gz ... FAILED
==> ERROR: One or more files did not pass the validity check!
error: failed to download sources for 'lemonade-server-9.1.4-1':
error: packages failed to build: lemonade-server-9.1.4-1

sha256sum v9.1.4.tar.gz
39693579ff993d7ed9dcb8fbc41d74556822452b73aeba57d27f350014951022  v9.1.4.tar.gz

update(9.1.4): lemonade recipes are now downloaded in ~/.cache/lemonade. You should delete usr/share/lemonade-server/llama to save space.

@jackweeks3 there is now an issue open and people are working on it, there is also a workaround if you or someone else needs it at the moment.

@jackweeks3 I just tried on my PC and it works fine for 9070XT and ROCm (and vulkan as well). Could this be caused by https://github.com/lemonade-sdk/lemonade/pull/826 ?

@luciddream thanks. I checked their github and they didn't have any open tickets on this issue so I posted here first to try and find out if it's just me.

I'm on a fresh CachyOS install using kernel 6.18.4-2-cachyos (the default kernel) on Strix Halo hardware and haven't had any issues running things like ComfyUI or similar until yesterday when I updated to 9.1.3 lemonade-server.

The first thing I did was bump the backend_version to (at the time) b1159 and re-ran with the same results. I also downloaded their ubuntu llama-b1159-ubuntu-rocm-gfx1151-x64.zip and tried that too. And I did as you suggested was totally remove the directory and let it redownload. Unfortunately I'm not apt enough to figure out what the libamd_comgr library issue is or if it's something else.

Any suggestions to get more debug logging would be nice, and I can always try and open a ticket on their github if it comes to it.

edit: tested vulkan backend and that works. Still can't get any reliable logging. Most of the time llama-server just core dumps with a seg fault when using rocm.

edit 2: did some gdb back trace debugging with free chatgpt, and it seems to think it's an issue with kernel and the bundled rocm stuff. I won't have time to chase this anymore so I'll probably switch to vulkan (fine for my use also) or try/create a docker image. Just know it's not likely an issue with your pkgbuild from what I can tell. Thanks!

@jackweeks3 hello, I haven't tried ROCm in the latest version because kernel 6.18 makes my GPU crash. But did you try to remove the rocm directory and let lemonade download it again? Maybe there was a network issue when you tried to run it. I will also take a look on my PC later tonight.

Since upgraded to 9.1.3 the llama-server (rocm) isn't working. It's segfaulting.

[LlamaCpp] Setting LD_LIBRARY_PATH=/usr/share/lemonade-server/llama/rocm Waiting for llama-server to be ready... implib-gen: libamd_comgr.so.3: failed to load library 'libamd_comgr.so.3' via callback 'amd_comgr_stub_dlopen' [ERROR] llama-server process has terminated with exit code: -1

same if I run llama-server directly. It worked in 9.1.2 and 9.1.1.

If you're having trouble with larger models on the ROCM backend, try --no-mmap like:

lemonade-server serve --llamacpp rocm --llamacpp-args "--flash-attn on --no-mmap"

lemonade-server has a systemd service unit. Use systemctl start lemond to start.

Default configuration is available at /usr/share/lemonade/defaults.json and should be placed at: /var/lib/lemonade/.cache/lemonade/config.json

Also /etc/lemonade/conf.d/zz-secrets.conf for the Lemonade API KEY.

The cache where all models, backends, and other files are stored is now in /var/lib/lemonade/.cache

GUI: lemonade-desktop.