TensorFold

Fast, exact LLM decoding on Apple Silicon (MLX) behind an OpenAI-compatible endpoint

LLM Inference & Serving
Local LLMs
APIs & SDKs

ai
ai-tools
llm
llm-inference
llm-tools

View on GitHub

Stars: 993
Forks: 169
+ today: +2
Created: 3mo

Ranking data as of October 5, 2026 (UTC).

Star History

Today, hour by hour

993 stars

Overview

Fast, exact LLM decoding on Apple Silicon (MLX) behind an OpenAI-compatible endpoint It ranks #338 on GitTiger, gaining +2 stars on October 5, 2026 (UTC).

The project is written in Python and has 169 forks. It was created 3mo ago.

Installation

git clone https://github.com/ashhart/TensorFold.git
cd TensorFold
# see README for setup