ai-infra

Open-source manuscript of “Understanding AI Infrastructure: Quantitative Analysis and System Design” by Bojie Li. Starting from hardware constraints and model architectures, it derives LLM inference and training system designs quantitatively; includes the full text, PDF, supporting calculation tools, and experiments.

图解 vLLM 推理引擎：100 课动手练习册 + ~500 行可运行的迷你推理引擎 | An illustrated, hands-on course on how vLLM works

Secure, Fast, and Extensible Sandbox runtime for AI agents.