Arch Linux User Repository

Search Criteria

Enter search criteria

Search by

Keywords

Out of Date

Sort by

Sort order

Per page

Package Details: python-tokenizers-bin 0.23.1-1

Package Actions

Git Clone URL:	https://aur.archlinux.org/python-tokenizers-bin.git (read-only, click to copy)
Package Base:	python-tokenizers-bin
Description:	Fast state-of-the-art tokenizers optimized for research and production (official wheel)
Upstream URL:	https://github.com/huggingface/tokenizers
Licenses:	Apache-2.0
Conflicts:	python-tokenizers
Provides:	python-tokenizers
Submitter:	Quatro
Maintainer:	Quatro
Last Packager:	Quatro
Votes:	0
Popularity:	0.000000
First Submitted:	2026-07-16 15:59 (UTC)
Last Updated:	2026-07-16 15:59 (UTC)

Dependencies (3)

python
python-huggingface-hub (python-huggingface-hub-git^AUR)
python-installer (make)

Required by (23)

comfyui-system (requires python-tokenizers)
gaia-amd (requires python-tokenizers)
immich-machine-learning (requires python-tokenizers)
litellm (requires python-tokenizers)
muzaiten-features-clap (requires python-tokenizers)
pix2tex (requires python-tokenizers)
python-accelerate (requires python-tokenizers) (check)
python-auralis (requires python-tokenizers)
python-bark-git (requires python-tokenizers)
python-chromadb (requires python-tokenizers)
python-cohere (requires python-tokenizers)
python-crewai (requires python-tokenizers)
python-curated-transformers (requires python-tokenizers)
python-fastembed (requires python-tokenizers)
python-faster-whisper (requires python-tokenizers)
python-litellm (requires python-tokenizers)
python-model2vec (requires python-tokenizers)
python-skorch (requires python-tokenizers) (check)
python-transformers (requires python-tokenizers)
python-transformers-git (requires python-tokenizers)
Show 3 more...

Sources (3)