@unit73e Should be fixed now. Thank you for your patch.
Search Criteria
Package Details: python-sentencepiece 0.2.0-5
Package Actions
Git Clone URL: | https://aur.archlinux.org/sentencepiece.git (read-only, click to copy) |
---|---|
Package Base: | sentencepiece |
Description: | Python wrapper for SentencePiece |
Upstream URL: | https://github.com/google/sentencepiece |
Licenses: | Apache-2.0 |
Submitter: | Henry-ZHR |
Maintainer: | Henry-ZHR |
Last Packager: | Henry-ZHR |
Votes: | 4 |
Popularity: | 0.144902 |
First Submitted: | 2024-03-10 06:42 (UTC) |
Last Updated: | 2025-05-05 13:53 (UTC) |
Dependencies (16)
- gcc-libs (gcc-libs-gitAUR, gccrs-libs-gitAUR, gcc-libs-snapshotAUR)
- glibc (glibc-gitAUR, glibc-linux4AUR, glibc-eacAUR)
- python (python37AUR, python311AUR, python310AUR)
- sentencepieceAUR
- abseil-cpp (abseil-cpp-gitAUR) (make)
- cmake (cmake3AUR, cmake-gitAUR) (make)
- git (git-gitAUR, git-glAUR) (make)
- gperftools (gperftools-gitAUR) (make)
- protobuf (protobuf-gitAUR) (make)
- python (python37AUR, python311AUR, python310AUR) (make)
- python-build (make)
- python-installer (make)
- python-setuptools (make)
- python-wheel (make)
- python-pytest (check)
- python-protobuf (python-protobuf-gitAUR, python-protobuf-21AUR) (optional)
Required by (21)
- argos-translate
- llama.cpp
- llama.cpp-cuda
- llama.cpp-cuda-f16
- llama.cpp-hip
- llama.cpp-sycl-f16
- llama.cpp-sycl-f32
- llama.cpp-vulkan
- localai-git
- localai-git-cuda
- localai-git-rocm
- python-aiplatform
- python-assistant
- python-gguf
- python-icefall-git
- python-inltk
- python-ktransformers
- python-open-clip-torch
- python-speechbrain-git
- python-torchmetrics (optional)
- Show 1 more...
Sources (4)
Henry-ZHR commented on 2025-05-05 13:54 (UTC)
unit73e commented on 2025-05-04 16:18 (UTC)
@Henry-ZHR to make it easy: https://github.com/unit73e/sentencepiece/commit/80e07aeb876374530056cb629a2296ee911b1448
unit73e commented on 2025-05-03 13:55 (UTC)
Fails to compile. Needs a patch like this:
diff -ura sentencepiece/src/sentencepiece_processor.h sentencepiece-new/src/sentencepiece_processor.h
--- sentencepiece/src/sentencepiece_processor.h 2025-05-03 14:50:30.662508417 +0100
+++ sentencepiece-new/src/sentencepiece_processor.h 2025-05-03 14:51:28.199349571 +0100
@@ -21,6 +21,7 @@
#include <string_view>
#include <utility>
#include <vector>
+#include <cstdint>
#ifndef SWIG
namespace absl {
It doesn't seem like there's an upstream fix commit yet.
Henry-ZHR commented on 2025-03-31 09:25 (UTC)
@kgizdov Fixed
kgizdov commented on 2025-03-31 09:06 (UTC)
It needs -DCMAKE_POLICY_VERSION_MINIMUM=3.5
to configure and build with recent CMake.
Henry-ZHR commented on 2025-03-28 15:36 (UTC)
@hashworks Are you compiling for a different architecture? If you aren't, did you use proper compiler flags?
And maybe try to run the test command directly with a debugger to see what happened. You should be able to find the actual command in build/Testing/Temporary/LastTest.log
in srcdir
hashworks commented on 2025-03-28 14:49 (UTC)
Check fails for me:
Successfully built sentencepiece-0.2.0-cp313-cp313-linux_x86_64.whl
==> Starting check()...
Internal ctest changing into directory: /home/hashworks/.cache/aurutils/sync/sentencepiece/src/sentencepiece/build
Test project /home/hashworks/.cache/aurutils/sync/sentencepiece/src/sentencepiece/build
Start 1: sentencepiece_test
1/1 Test #1: sentencepiece_test ...............***Exception: Illegal 0.01 sec
[ RUN ] PretokenizerForTrainingTest.BaseTest
0% tests passed, 1 tests failed out of 1
Total Test time (real) = 0.01 sec
The following tests FAILED:
1 - sentencepiece_test (ILLEGAL)
Errors while running CTest
Henry-ZHR commented on 2025-03-27 08:58 (UTC)
@micwoj92 Done
micwoj92 commented on 2025-03-27 08:12 (UTC)
Please add glibc and gcc-libs to deps of python-sentencepiece.
Pinned Comments
Henry-ZHR commented on 2024-03-26 14:38 (UTC)
For everyone:
You may need to rebuild the package when its dependencies (currently
abseil-cpp
,protobuf
andgperftools
) are upgraded.You can install rebuild-detector so that you will be warned when you need to do so.