tiny-transformer-from-scratch
A tiny Transformer built from scratch in PyTorch, with an English-to-Chinese translation demo | 用 PyTorch 从零实现的小型 Transformer，附英译中演示，帮助理解模型原理
- attention-mechanism
- deep-learning
- educational
- from-scratch
- machine-translation
- pytorch
- transformer
- Stars
- 43
- Forks
- 2
- + today
- +1
- Created
- 2d
Ranking data as of November 3, 2026 (UTC).
Star History
Today, hour by hour
01
Overview
A tiny Transformer built from scratch in PyTorch, with an English-to-Chinese translation demo | 用 PyTorch 从零实现的小型 Transformer，附英译中演示，帮助理解模型原理 It ranks #4038 on GitTiger, gaining +1 star on November 3, 2026 (UTC).
The project is written in Jupyter Notebook and has 2 forks. It was created 2d ago.
Installation
git clone https://github.com/Zguoxu/tiny-transformer-from-scratch.git
cd tiny-transformer-from-scratch
# see README for setup