LLMs-from-scratch
Implement a ChatGPT-like LLM in PyTorch from scratch, step by step
- gpt
- large-language-models
- llm
- python
- pytorch
- ai
- artificial-intelligence
- language-model
- deep-learning
- machine-learning
- from-scratch
- generative-ai
- transformers
- attention-mechanism
- finetuning
- Stars
- 106,014
- Forks
- 16,309
- + today
- +1
- Created
- 3y
Ranking data as of October 5, 2026 (UTC).
Star History
Today, hour by hour
01
Overview
Implement a ChatGPT-like LLM in PyTorch from scratch, step by step It ranks #3147 on GitTiger, gaining +1 star on October 5, 2026 (UTC).
The project is written in Jupyter Notebook and has 16,309 forks. It was created 3y ago.
Installation
git clone https://github.com/rasbt/LLMs-from-scratch.git
cd LLMs-from-scratch
# see README for setup