llama

A high-throughput and memory-efficient inference and serving engine for LLMs

AI Agent Assistant & development framework that integrates lots of IM platforms, LLMs, plugins and AI feature, and can be your openclaw alternative. ✨

Run Claude Code 100% on-device with local AI on Apple Silicon. MLX-native Anthropic-API server. 6 fighters incl. Muse-Glimmer 30B (now multimodal — reads images, abliterated), Gemma 4 31B, Qwen 3.5 122B (65 tok/s), DeepSeek V4 Flash (1M ctx). Private, offline, airgap-ready. Built for NDA / legal / h

SOTA Open Source TTS

Eagle: Frontier Vision-Language Models with Data-Centric Strategies

Unified Efficient Fine-Tuning of 100+ LLMs & VLMs (ACL 2024)

YuE2: frontier music generation with symbolic planning, zero-shot covers, and agentic music editing.

Get up and running with Kimi, GLM, MiniMax, DeepSeek, gpt-oss, Qwen, Gemma and other models.

aider is AI pair programming in your terminal

Efficient Triton Kernels for LLM Training

Build a modern LLM from scratch. Every line commented. Explained like we are five.