Skip to main content
Back to trending

mlx-serve

Native LLM inference server for Apple Silicon. OpenAI + Anthropic API compatible. No Python. Zig backend, Swift frontend macOS app with chat, music, voice, video generation.

  • agent
  • anthropic-api
  • apple-silicon
  • claude-code
  • inference
  • llm
  • local-llm
  • macos
  • macos-app
  • mlx
  • openai-api
  • tool-calling
  • zig
  • deepseek-v4
  • diffusion
View on GitHub
Stars
1,763
Forks
178
+ today
+1
Created
7mo

Ranking data as of October 5, 2026 (UTC).

Star History

Today, hour by hour

1,763 stars
01

Overview

Native LLM inference server for Apple Silicon. OpenAI + Anthropic API compatible. No Python. Zig backend, Swift frontend macOS app with chat, music, voice, video generation. It ranks #1416 on GitTiger, gaining +1 star on October 5, 2026 (UTC).

The project is written in Zig and has 178 forks. It was created 7mo ago.

Installation
git clone https://github.com/ddalcu/mlx-serve.git
cd mlx-serve
# see README for setup