Package Details: python-sentencepiece 0.2.0-5

Git Clone URL: https://aur.archlinux.org/sentencepiece.git (read-only, click to copy)
Package Base: sentencepiece
Description: Python wrapper for SentencePiece
Upstream URL: https://github.com/google/sentencepiece
Licenses: Apache-2.0
Submitter: Henry-ZHR
Maintainer: Henry-ZHR
Last Packager: Henry-ZHR
Votes: 4
Popularity: 0.144902
First Submitted: 2024-03-10 06:42 (UTC)
Last Updated: 2025-05-05 13:53 (UTC)

Pinned Comments

Henry-ZHR commented on 2024-03-26 14:38 (UTC)

For everyone:

You may need to rebuild the package when its dependencies (currently abseil-cpp, protobuf and gperftools) are upgraded.

You can install rebuild-detector so that you will be warned when you need to do so.

Latest Comments

1 2 Next › Last »

Henry-ZHR commented on 2025-05-05 13:54 (UTC)

@unit73e Should be fixed now. Thank you for your patch.

unit73e commented on 2025-05-04 16:18 (UTC)

@Henry-ZHR to make it easy: https://github.com/unit73e/sentencepiece/commit/80e07aeb876374530056cb629a2296ee911b1448

unit73e commented on 2025-05-03 13:55 (UTC)

Fails to compile. Needs a patch like this:

diff -ura sentencepiece/src/sentencepiece_processor.h sentencepiece-new/src/sentencepiece_processor.h
--- sentencepiece/src/sentencepiece_processor.h 2025-05-03 14:50:30.662508417 +0100
+++ sentencepiece-new/src/sentencepiece_processor.h 2025-05-03 14:51:28.199349571 +0100
@@ -21,6 +21,7 @@
 #include <string_view>
 #include <utility>
 #include <vector>
+#include <cstdint>

 #ifndef SWIG
 namespace absl {

It doesn't seem like there's an upstream fix commit yet.

Henry-ZHR commented on 2025-03-31 09:25 (UTC)

@kgizdov Fixed

kgizdov commented on 2025-03-31 09:06 (UTC)

It needs -DCMAKE_POLICY_VERSION_MINIMUM=3.5 to configure and build with recent CMake.

Henry-ZHR commented on 2025-03-28 15:36 (UTC)

@hashworks Are you compiling for a different architecture? If you aren't, did you use proper compiler flags?

And maybe try to run the test command directly with a debugger to see what happened. You should be able to find the actual command in build/Testing/Temporary/LastTest.log in srcdir

hashworks commented on 2025-03-28 14:49 (UTC)

Check fails for me:

Successfully built sentencepiece-0.2.0-cp313-cp313-linux_x86_64.whl
==> Starting check()...
Internal ctest changing into directory: /home/hashworks/.cache/aurutils/sync/sentencepiece/src/sentencepiece/build
Test project /home/hashworks/.cache/aurutils/sync/sentencepiece/src/sentencepiece/build
    Start 1: sentencepiece_test
1/1 Test #1: sentencepiece_test ...............***Exception: Illegal  0.01 sec
[ RUN      ] PretokenizerForTrainingTest.BaseTest


0% tests passed, 1 tests failed out of 1

Total Test time (real) =   0.01 sec

The following tests FAILED:
     1 - sentencepiece_test (ILLEGAL)
Errors while running CTest

Henry-ZHR commented on 2025-03-27 08:58 (UTC)

@micwoj92 Done

micwoj92 commented on 2025-03-27 08:12 (UTC)

Please add glibc and gcc-libs to deps of python-sentencepiece.