Package Details: llm 0.1.1-5

Git Clone URL: https://aur.archlinux.org/llm.git (read-only, click to copy)
Package Base: llm
Description: Run inference for Large Language Models on CPU, with Rust 🦀🚀🦙
Upstream URL: https://github.com/rustformers/llm
Licenses: Apache-2.0 OR MIT
Conflicts: llm
Provides: llm
Submitter: None
Maintainer: None
Last Packager: None
Votes: 0
Popularity: 0.000000
First Submitted: 2023-05-13 01:50 (UTC)
Last Updated: 2024-04-07 14:57 (UTC)

Latest Comments

<deleted-account> commented on 2024-04-07 14:57 (UTC)

@dreieck done

dreieck commented on 2024-03-26 08:43 (UTC)

You need to add options+=('!lto'), otherwise build() fails while linking in environments where LTO is default: 

error: linking with `cc` failed: exit status: 1
  |
  = note: LC_ALL="C" PATH="/usr/lib64/rustlib/x86_64-unknown-linux-gnu/bin:/usr/local/bin:/usr/bin:/bin:/usr/local/sbin:/opt/android-sdk/emulator:/opt/android-sdk/cmdline-tools/latest/bin:/opt/android-sdk/platform-tools:/usr/lib/jvm/default/bin:/usr/bin/site_perl:/usr/bin/vendor_perl:/usr/bin/core_perl:/opt/rocm/bin:/usr/local/bin:/usr/local/sbin:/home/felics/bin" VSLANG="1033" "cc" "-m64" "/tmp/rustc3AwnX9/symbols.o" "/tmp/makepkg/build/llm/src/llm/target/release/deps/llm-d7087f46f7bb0208.llm.9075617fcae60d0b-cgu.00.rcgu.o" "/tmp/makepkg/build/llm/src/llm/target/release/deps/llm-d7087f46f7bb0208.llm.9075617fcae60d0b-cgu.01.rcgu.o" "/tmp/makepkg/build/llm/src/llm/target/release/deps/llm-d7087f46f7bb0208.llm.9075617fcae60d0b-cgu.02.rcgu.o" "/tmp/makepkg/build/llm/src/llm/target/release/deps/llm-d7087f46f7bb0208.llm.9075617fcae60d0b-cgu.03.rcgu.o" "/tmp/makepkg/build/llm/src/llm/target/release/deps/llm-d7087f46f7bb0208.llm.9075617fcae60d0b-cgu.04.rcgu.o" "/tmp/makepkg/build/llm/src/llm/target/release/deps/llm-d7087f46f7bb0208.llm.9075617fcae60d0b-cgu.05.rcgu.o" "/tmp/makepkg/build/llm/src/llm/target/release/deps/llm-d7087f46f7bb0208.llm.9075617fcae60d0b-cgu.06.rcgu.o" "/tmp/makepkg/build/llm/src/llm/target/release/deps/llm-d7087f46f7bb0208.llm.9075617fcae60d0b-cgu.07.rcgu.o" "/tmp/makepkg/build/llm/src/llm/target/release/deps/llm-d7087f46f7bb0208.llm.9075617fcae60d0b-cgu.08.rcgu.o" "/tmp/makepkg/build/llm/src/llm/target/release/deps/llm-d7087f46f7bb0208.llm.9075617fcae60d0b-cgu.09.rcgu.o" "/tmp/makepkg/build/llm/src/llm/target/release/deps/llm-d7087f46f7bb0208.llm.9075617fcae60d0b-cgu.10.rcgu.o" "/tmp/makepkg/build/llm/src/llm/target/release/deps/llm-d7087f46f7bb0208.llm.9075617fcae60d0b-cgu.11.rcgu.o" "/tmp/makepkg/build/llm/src/llm/target/release/deps/llm-d7087f46f7bb0208.llm.9075617fcae60d0b-cgu.12.rcgu.o" "/tmp/makepkg/build/llm/src/llm/target/release/deps/llm-d7087f46f7bb0208.llm.9075617fcae60d0b-cgu.13.rcgu.o" "/tmp/makepkg/build/llm/src/llm/target/release/deps/llm-d7087f46f7bb0208.llm.9075617fcae60d0b-cgu.14.rcgu.o" "/tmp/makepkg/build/llm/src/llm/target/release/deps/llm-d7087f46f7bb0208.llm.9075617fcae60d0b-cgu.15.rcgu.o" "/tmp/makepkg/build/llm/src/llm/target/release/deps/llm-d7087f46f7bb0208.5enbhsoswp60sdo6.rcgu.o" "-Wl,--as-needed" "-L" "/tmp/makepkg/build/llm/src/llm/target/release/deps" "-L" "/tmp/makepkg/build/llm/src/llm/target/release/build/ggml-sys-359ee04353f440dc/out" "-L" "/tmp/makepkg/build/llm/src/llm/target/release/build/zstd-sys-2f5e156b6ab4158a/out" "-L" "/usr/lib64/rustlib/x86_64-unknown-linux-gnu/lib" "-Wl,-Bstatic" "/tmp/makepkg/build/llm/src/llm/target/release/deps/libenv_logger-6628f0d4379d6b36.rlib" "/tmp/makepkg/build/llm/src/llm/target/release/deps/libtermcolor-bff838dc43c32519.rlib" "/tmp/makepkg/build/llm/src/llm/target/release/deps/libhumantime-ba0080b0f849bdbe.rlib" "/tmp/makepkg/build/llm/src/llm/target/release/deps/libbincode-1ccd57464d0340c4.rlib" "/tmp/makepkg/build/llm/src/llm/target/release/deps/libbytesize-651025f53def810d.rlib" "/tmp/makepkg/build/llm/src/llm/target/release/deps/libspinoff-b41690289e802c69.rlib" "/tmp/makepkg/build/llm/src/llm/target/release/deps/libcolored-a314805b3a95e2ba.rlib" "/tmp/makepkg/build/llm/src/llm/target/release/deps/libatty-15a32c974315c9ae.rlib" "/tmp/makepkg/build/llm/src/llm/target/release/deps/libzstd-76676edf0dcd3506.rlib" "/tmp/makepkg/build/llm/src/llm/target/release/deps/libzstd_safe-46c593df5da727f7.rlib" "/tmp/makepkg/build/llm/src/llm/target/release/deps/libzstd_sys-52d2977f9a10ac93.rlib" "/tmp/makepkg/build/llm/src/llm/target/release/deps/librustyline-0979b136658cc350.rlib" "/tmp/makepkg/build/llm/src/llm/target/release/deps/libnix-4a57005a96d393ba.rlib" "/tmp/makepkg/build/llm/src/llm/target/release/deps/libfd_lock-e7a2738481271c08.rlib" "/tmp/makepkg/build/llm/src/llm/target/release/deps/libunicode_width-2569195d6e228612.rlib" "/tmp/makepkg/build/llm/src/llm/target/release/deps/libunicode_segmentation-e2d3883f759392d7.rlib" "/tmp/makepkg/build/llm/src/llm/target/release/deps/liblog-69709688c4dd7486.rlib" "/tmp/makepkg/build/llm/src/llm/target/release/deps/libdirs_next-e4602382bc586ecc.rlib" "/tmp/makepkg/build/llm/src/llm/target/release/deps/libdirs_sys_next-944d136c68e4c9f2.rlib" "/tmp/makepkg/build/llm/src/llm/target/release/deps/libradix_trie-ba4c9819cdc146ee.rlib" "/tmp/makepkg/build/llm/src/llm/target/release/deps/libnibble_vec-592d3dfc93ebb27b.rlib" "/tmp/makepkg/build/llm/src/llm/target/release/deps/libendian_type-2932c12c9e304fd7.rlib" "/tmp/makepkg/build/llm/src/llm/target/release/deps/libllm-2e077b0b3f813d5c.rlib" "/tmp/makepkg/build/llm/src/llm/target/release/deps/libllm_neox-e2b92d70e5cd8a37.rlib" "/tmp/makepkg/build/llm/src/llm/target/release/deps/libllm_llama-aae34a9fdfa87fdd.rlib" "/tmp/makepkg/build/llm/src/llm/target/release/deps/librust_tokenizers-312a55e03d4c55b5.rlib" "/tmp/makepkg/build/llm/src/llm/target/release/deps/libcsv-b7cbf9ce47e4cf1e.rlib" "/tmp/makepkg/build/llm/src/llm/target/release/deps/libcsv_core-a5f7fc20b873b9eb.rlib" "/tmp/makepkg/build/llm/src/llm/target/release/deps/libserde_json-ed21c539ca598f01.rlib" "/tmp/makepkg/build/llm/src/llm/target/release/deps/libryu-e6ddf5cb5a55e777.rlib" "/tmp/makepkg/build/llm/src/llm/target/release/deps/libitoa-f381edc23658ff71.rlib" "/tmp/makepkg/build/llm/src/llm/target/release/deps/libunicode_normalization_alignments-c2c9e4bf2069006c.rlib" "/tmp/makepkg/build/llm/src/llm/target/release/deps/libsmallvec-1c0ea7af2afa85d7.rlib" "/tmp/makepkg/build/llm/src/llm/target/release/deps/libunicode_normalization-511cde056d0a4363.rlib" "/tmp/makepkg/build/llm/src/llm/target/release/deps/libtinyvec-701abf3bb4eb51c4.rlib" "/tmp/makepkg/build/llm/src/llm/target/release/deps/libtinyvec_macros-91c5958a07525e88.rlib" "/tmp/makepkg/build/llm/src/llm/target/release/deps/libregex-545bafea0ba66ac1.rlib" "/tmp/makepkg/build/llm/src/llm/target/release/deps/libaho_corasick-ce1d940344e01fa6.rlib" "/tmp/makepkg/build/llm/src/llm/target/release/deps/libregex_syntax-c4678dd0819ecaaf.rlib" "/tmp/makepkg/build/llm/src/llm/target/release/deps/librayon-b94d232b703bf4dc.rlib" "/tmp/makepkg/build/llm/src/llm/target/release/deps/librayon_core-bccc105480cd67f6.rlib" "/tmp/makepkg/build/llm/src/llm/target/release/deps/libnum_cpus-f325bbe7fb7587cc.rlib" "/tmp/makepkg/build/llm/src/llm/target/release/deps/libcrossbeam_deque-057cedde8c7ecf7d.rlib" "/tmp/makepkg/build/llm/src/llm/target/release/deps/libcrossbeam_epoch-d26cab37edae1ec8.rlib" "/tmp/makepkg/build/llm/src/llm/target/release/deps/libmemoffset-b62722db65119127.rlib" "/tmp/makepkg/build/llm/src/llm/target/release/deps/libscopeguard-1650f50f9002514c.rlib" "/tmp/makepkg/build/llm/src/llm/target/release/deps/libcrossbeam_channel-d435099ecfd5f101.rlib" "/tmp/makepkg/build/llm/src/llm/target/release/deps/libcrossbeam_utils-c2e5850109fc912e.rlib" "/tmp/makepkg/build/llm/src/llm/target/release/deps/libitertools-8270158fc8589317.rlib" "/tmp/makepkg/build/llm/src/llm/target/release/deps/libeither-194b6ee2e1cc0bf9.rlib" "/tmp/makepkg/build/llm/src/llm/target/release/deps/libhashbrown-1ccdf9c0531fefa0.rlib" "/tmp/makepkg/build/llm/src/llm/target/release/deps/libahash-18eeff4987fe6c7d.rlib" "/tmp/makepkg/build/llm/src/llm/target/release/deps/libprotobuf-34a032c38efa6473.rlib" "/tmp/makepkg/build/llm/src/llm/target/release/deps/liblazy_static-0661a63315167bc5.rlib" "/tmp/makepkg/build/llm/src/llm/target/release/deps/libllm_gptj-afaaaef4921431dc.rlib" "/tmp/makepkg/build/llm/src/llm/target/release/deps/libllm_gpt2-0589369a3f89c31e.rlib" "/tmp/makepkg/build/llm/src/llm/target/release/deps/libllm_bloom-49a5d21a7e1ddb99.rlib" "/tmp/makepkg/build/llm/src/llm/target/release/deps/libllm_base-3516925c30f44e76.rlib" "/tmp/makepkg/build/llm/src/llm/target/release/deps/libbytemuck-8423b43317a5ab25.rlib" "/tmp/makepkg/build/llm/src/llm/target/release/deps/libserde_bytes-b067d09b04dc6b85.rlib" "/tmp/makepkg/build/llm/src/llm/target/release/deps/libserde-f0b293d3196c0729.rlib" "/tmp/makepkg/build/llm/src/llm/target/release/deps/libhalf-8f79502fafda875e.rlib" "/tmp/makepkg/build/llm/src/llm/target/release/deps/libmemmap2-e738e27efb59a59d.rlib" "/tmp/makepkg/build/llm/src/llm/target/release/deps/libggml-94bfbc7eabc9cd4f.rlib" "/tmp/makepkg/build/llm/src/llm/target/release/deps/libggml_sys-1df9884fa950a875.rlib" "/tmp/makepkg/build/llm/src/llm/target/release/deps/librand-1def6c4d269f67e9.rlib" "/tmp/makepkg/build/llm/src/llm/target/release/deps/librand_chacha-2a6a2f2ee66ec4a0.rlib" "/tmp/makepkg/build/llm/src/llm/target/release/deps/libppv_lite86-5bcc25de8116e54c.rlib" "/tmp/makepkg/build/llm/src/llm/target/release/deps/librand_core-009fd9d3cbedef2b.rlib" "/tmp/makepkg/build/llm/src/llm/target/release/deps/libgetrandom-d1e274875b0a6266.rlib" "/tmp/makepkg/build/llm/src/llm/target/release/deps/libpartial_sort-79b437450d87784f.rlib" "/tmp/makepkg/build/llm/src/llm/target/release/deps/libthiserror-e839b4700b2ce3da.rlib" "/tmp/makepkg/build/llm/src/llm/target/release/deps/libcolor_eyre-477fd629fb50b0fb.rlib" "/tmp/makepkg/build/llm/src/llm/target/release/deps/libowo_colors-cec685f1040ef094.rlib" "/tmp/makepkg/build/llm/src/llm/target/release/deps/libeyre-3f441a32cd835ca7.rlib" "/tmp/makepkg/build/llm/src/llm/target/release/deps/libindenter-10959f4076d8b464.rlib" "/tmp/makepkg/build/llm/src/llm/target/release/deps/libbacktrace-141809cc8d5bc3be.rlib" "/tmp/makepkg/build/llm/src/llm/target/release/deps/libminiz_oxide-c52c22b4043b6e31.rlib" "/tmp/makepkg/build/llm/src/llm/target/release/deps/libadler-4ec3598f144919a7.rlib" "/tmp/makepkg/build/llm/src/llm/target/release/deps/libobject-2a5a67ada3f9e8dd.rlib" "/tmp/makepkg/build/llm/src/llm/target/release/deps/libmemchr-45646d3f4e920e53.rlib" "/tmp/makepkg/build/llm/src/llm/target/release/deps/libaddr2line-ba886328c2d06691.rlib" "/tmp/makepkg/build/llm/src/llm/target/release/deps/libgimli-c55373b0bd004ff9.rlib" "/tmp/makepkg/build/llm/src/llm/target/release/deps/libcfg_if-498df34d333ecefd.rlib" "/tmp/makepkg/build/llm/src/llm/target/release/deps/librustc_demangle-9232eea1c7caa320.rlib" "/tmp/makepkg/build/llm/src/llm/target/release/deps/libclap-bf6c925199a5b4a5.rlib" "/tmp/makepkg/build/llm/src/llm/target/release/deps/libonce_cell-9c9735cd312fd486.rlib" "/tmp/makepkg/build/llm/src/llm/target/release/deps/libclap_builder-e65a2bf7a0c22446.rlib" "/tmp/makepkg/build/llm/src/llm/target/release/deps/libstrsim-e8b313b8b2713d96.rlib" "/tmp/makepkg/build/llm/src/llm/target/release/deps/libanstream-a0ef220b667c0a46.rlib" "/tmp/makepkg/build/llm/src/llm/target/release/deps/libanstyle_query-41054b448541ef74.rlib" "/tmp/makepkg/build/llm/src/llm/target/release/deps/libis_terminal-a23648fc999641f8.rlib" "/tmp/makepkg/build/llm/src/llm/target/release/deps/librustix-450e16fbfd290ae7.rlib" "/tmp/makepkg/build/llm/src/llm/target/release/deps/liblinux_raw_sys-e0e46af499dd9d29.rlib" "/tmp/makepkg/build/llm/src/llm/target/release/deps/libio_lifetimes-799e55225661f0bf.rlib" "/tmp/makepkg/build/llm/src/llm/target/release/deps/liblibc-1f6fee0a552d5257.rlib" "/tmp/makepkg/build/llm/src/llm/target/release/deps/libanstyle-c6ec3c57a3acc9a4.rlib" "/tmp/makepkg/build/llm/src/llm/target/release/deps/libcolorchoice-8ca058d403b29a51.rlib" "/tmp/makepkg/build/llm/src/llm/target/release/deps/libanstyle_parse-af9c540d5273b968.rlib" "/tmp/makepkg/build/llm/src/llm/target/release/deps/libutf8parse-9c18ddfc21574813.rlib" "/tmp/makepkg/build/llm/src/llm/target/release/deps/libclap_lex-264d3a17e8e7a8d7.rlib" "/tmp/makepkg/build/llm/src/llm/target/release/deps/libbitflags-b52af69805482459.rlib" "/usr/lib64/rustlib/x86_64-unknown-linux-gnu/lib/libstd-cc50f93f7719c7b3.rlib" "/usr/lib64/rustlib/x86_64-unknown-linux-gnu/lib/libpanic_unwind-5af968c29c409d45.rlib" "/usr/lib64/rustlib/x86_64-unknown-linux-gnu/lib/libobject-011c4bb5e65e21e2.rlib" "/usr/lib64/rustlib/x86_64-unknown-linux-gnu/lib/libmemchr-c8c52878eda5b158.rlib" "/usr/lib64/rustlib/x86_64-unknown-linux-gnu/lib/libaddr2line-8f913a0b92e0c685.rlib" "/usr/lib64/rustlib/x86_64-unknown-linux-gnu/lib/libgimli-75df042bfdda2337.rlib" "/usr/lib64/rustlib/x86_64-unknown-linux-gnu/lib/librustc_demangle-c037587cd9f1e9e5.rlib" "/usr/lib64/rustlib/x86_64-unknown-linux-gnu/lib/libstd_detect-c02f5a643901b2f3.rlib" "/usr/lib64/rustlib/x86_64-unknown-linux-gnu/lib/libhashbrown-9c5b978f596f1b61.rlib" "/usr/lib64/rustlib/x86_64-unknown-linux-gnu/lib/librustc_std_workspace_alloc-c49da01a1ce9701c.rlib" "/usr/lib64/rustlib/x86_64-unknown-linux-gnu/lib/libminiz_oxide-9b750cf2e8d5db9e.rlib" "/usr/lib64/rustlib/x86_64-unknown-linux-gnu/lib/libadler-45bd5122bf647adf.rlib" "/usr/lib64/rustlib/x86_64-unknown-linux-gnu/lib/libunwind-055603ceb1c59022.rlib" "/usr/lib64/rustlib/x86_64-unknown-linux-gnu/lib/libcfg_if-0b277da9a6bd5b81.rlib" "/usr/lib64/rustlib/x86_64-unknown-linux-gnu/lib/liblibc-92b99a026ce7ec4d.rlib" "/usr/lib64/rustlib/x86_64-unknown-linux-gnu/lib/liballoc-8148d8973cadcd24.rlib" "/usr/lib64/rustlib/x86_64-unknown-linux-gnu/lib/librustc_std_workspace_core-f10babec2ad976c6.rlib" "/usr/lib64/rustlib/x86_64-unknown-linux-gnu/lib/libcore-ae9feece760532ff.rlib" "/usr/lib64/rustlib/x86_64-unknown-linux-gnu/lib/libcompiler_builtins-1cdad4275bc9441f.rlib" "-Wl,-Bdynamic" "-lgcc_s" "-lutil" "-lrt" "-lpthread" "-lm" "-ldl" "-lc" "-Wl,--eh-frame-hdr" "-Wl,-z,noexecstack" "-L" "/usr/lib64/rustlib/x86_64-unknown-linux-gnu/lib" "-o" "/tmp/makepkg/build/llm/src/llm/target/release/deps/llm-d7087f46f7bb0208" "-Wl,--gc-sections" "-pie" "-Wl,-z,relro,-z,now" "-Wl,-O1" "-Wl,--strip-debug" "-nodefaultlibs"
  = note: /usr/bin/ld: /tmp/makepkg/build/llm/src/llm/target/release/deps/libggml-94bfbc7eabc9cd4f.rlib(ggml-94bfbc7eabc9cd4f.ggml.9fc18c939aa3f25a-cgu.0.rcgu.o): in function `ggml::context::Context::init':
          ggml.9fc18c939aa3f25a-cgu.0:(.text._ZN4ggml7context7Context4init17hc43915ba3c15f1bbE+0x33): undefined reference to `ggml_init'
          /usr/bin/ld: /tmp/makepkg/build/llm/src/llm/target/release/deps/libggml-94bfbc7eabc9cd4f.rlib(ggml-94bfbc7eabc9cd4f.ggml.9fc18c939aa3f25a-cgu.0.rcgu.o): in function `ggml::context::Context::new_tensor_1d':
          ggml.9fc18c939aa3f25a-cgu.0:(.text._ZN4ggml7context7Context13new_tensor_1d17h3d0406677142a3c8E+0x21): undefined reference to `ggml_new_tensor_1d'
          /usr/bin/ld: /tmp/makepkg/build/llm/src/llm/target/release/deps/libggml-94bfbc7eabc9cd4f.rlib(ggml-94bfbc7eabc9cd4f.ggml.9fc18c939aa3f25a-cgu.0.rcgu.o): in function `ggml::context::Context::new_tensor_2d':
          ggml.9fc18c939aa3f25a-cgu.0:(.text._ZN4ggml7context7Context13new_tensor_2d17h506524e9e723ae21E+0x26): undefined reference to `ggml_new_tensor_2d'
          /usr/bin/ld: /tmp/makepkg/build/llm/src/llm/target/release/deps/libggml-94bfbc7eabc9cd4f.rlib(ggml-94bfbc7eabc9cd4f.ggml.9fc18c939aa3f25a-cgu.0.rcgu.o): in function `ggml::context::Context::new_tensor_3d':
          ggml.9fc18c939aa3f25a-cgu.0:(.text._ZN4ggml7context7Context13new_tensor_3d17he57fa20c381cd57bE+0x2b): undefined reference to `ggml_new_tensor_3d'
[...]

Regards!

dreieck commented on 2024-03-26 08:41 (UTC)

Can you please move all the rust specific download stuff out from build() and into prepare(), so that build() can work in an offline environment?

Regards and thanks for maintaining!

==> Starting build()...
    Updating crates.io index
  Downloaded anstyle v1.0.0
  Downloaded addr2line v0.19.0
  Downloaded atty v0.2.14
  Downloaded clap_lex v0.4.1
  Downloaded anstyle-query v1.0.0
  Downloaded endian-type v0.1.2
  Downloaded partial_sort v0.2.0
  Downloaded indenter v0.3.3
  Downloaded bytesize v1.2.0
  Downloaded anstream v0.3.2
[...]