Skip to main content
Back to trending

tiny-llm

learn LLM inference system on Apple Silicon for systems engineers: build a tiny vLLM + Qwen

  • course
  • large-language-model
  • llm
  • python
  • qwen
  • serving
  • vllm
View on GitHub
Stars
5,340
Forks
484
+ today
+7
Created
1y

Ranking data as of October 30, 2026 (UTC).

Star History

Today, hour by hour

5,340 stars
07

Overview

learn LLM inference system on Apple Silicon for systems engineers: build a tiny vLLM + Qwen It ranks #40 on GitTiger, gaining +7 stars on October 30, 2026 (UTC).

The project is written in Python and has 484 forks. It was created 1y ago.

Installation
git clone https://github.com/skyzh/tiny-llm.git
cd tiny-llm
# see README for setup