FreeToken
FreeToken brings datacenter-scale model serving to your desktop. Run massive models locally, fast and efficiently.
- deepseek-v4
- edge
- glm
- inference
- minimax
- moe
- qwen
- transformer
- Stars
- 14,991
- Forks
- 1,518
- + today
- +6
- Created
- 3mo
Ranking data as of October 31, 2026 (UTC).
Star History
Today, hour by hour
06
Overview
FreeToken brings datacenter-scale model serving to your desktop. Run massive models locally, fast and efficiently. It ranks #62 on GitTiger, gaining +6 stars on October 31, 2026 (UTC).
The project is written in Python and has 1,518 forks. It was created 3mo ago.
Installation
git clone https://github.com/FlashML-org/FreeToken.git
cd FreeToken
# see README for setup