Package Details: python-tokenizers 0.10.3-1

Git Clone URL: https://aur.archlinux.org/python-tokenizers.git (read-only, click to copy)
Package Base: python-tokenizers
Description: Fast and Customizable Tokenizers
Upstream URL: https://github.com/huggingface/tokenizers
Licenses: Apache License 2.0
Submitter: filipg
Maintainer: filipg
Last Packager: filipg
Votes: 0
Popularity: 0.000000
First Submitted: 2021-10-23 11:17
Last Updated: 2021-10-23 11:17