Skip to main content

Tag · 3 repos

ai-infrastructure

Repositories carrying the ai-infrastructure tag.

Exact tag match3 sample repositories
1695
bojieli/ai-infra-book

Open-source manuscript of “Understanding AI Infrastructure: Quantitative Analysis and System Design” by Bojie Li. Starting from hardware constraints and model architectures, it derives LLM inference and training system designs quantitatively; includes the full text, PDF, supporting calculation tools, and experiments.

PythonLLM Inference & ServingAwesome Lists & Learning
2798
HarnessRouter/harnessrouter

HarnessRouter Community Edition: the self-hosted, Apache-2.0 edition of the unified interface for agent harnesses. Run Codex, Claude Code, Hermes, PI, DSH, and more through one API, with sessions, streaming, files, cancellation, and failure handling. Implements the Unified Harness Protocol (UHP), an

PythonAI AgentsAI Coding Assistants
6193
zhuorudan/dual-spark-cluster

Dual NVIDIA DGX Spark cluster operator: TP=2 LLM sering, one-key model switching, Dify protocol shim, wachdog, ops panel

ShellLLM Inference & ServingSelf-Hosted Apps