petals

🌸 Run LLMs at home, BitTorrent-style. Fine-tuning and inference up to 10x faster than offloading

Machine Learning & Data Science
Chatbots & LLM Apps
Fine-tuning & Training

bloom
deep-learning
distributed-systems
language-models
large-language-models
machine-learning
neural-networks
pytorch
volunteer-computing
pipeline-parallelism
tensor-parallelism
guanaco
llama
chatbot
gpt

View on GitHub

Stars: 10,685
Forks: 650
+ today: +1
Created: 4y

Ranking data as of November 2, 2026 (UTC).

Star History

Today, hour by hour

10,685 stars

Overview

🌸 Run LLMs at home, BitTorrent-style. Fine-tuning and inference up to 10x faster than offloading It ranks #1114 on GitTiger, gaining +1 star on November 2, 2026 (UTC).

The project is written in Python and has 650 forks. It was created 4y ago.

Installation

git clone https://github.com/bigscience-workshop/petals.git
cd petals
# see README for setup