Skip to main content
Back to trending

llm-architecture-from-scratch

Implementing LLM architectures from scratch in PyTorch

  • gemma3
  • llama4
  • llm
  • moe
  • qwen3
View on GitHub
Stars
522
Forks
1
+ today
+4
Created
28d

Ranking data as of October 13, 2026 (UTC).

Star History

Today, hour by hour

522 stars
04

Overview

Implementing LLM architectures from scratch in PyTorch It ranks #72 on GitTiger, gaining +4 stars on October 13, 2026 (UTC).

The project is written in Python and has 1 fork. It was created 28d ago.

Installation
git clone https://github.com/YeonwooSung/llm-architecture-from-scratch.git
cd llm-architecture-from-scratch
# see README for setup