- Stars
- 1
- Forks
- 0
- + today
- +1
- Created
- —
Ranking data as of October 1, 2026 (UTC).
Overview
huggingface/tokenizers — trending on GitHub. It ranks #817 on GitTiger, gaining +1 star on October 1, 2026 (UTC).
Installation
git clone https://github.com/huggingface/tokenizers.git
cd tokenizers
# see README for setup