Skip to main content
Back to trending

OmniInfer

Unified, efficient, and easy-to-use inference infrastructure for edge AI || 面向端侧 AI 的统一、高效、易用的推理基础设施

View on GitHub
Stars
1,733
Forks
12
+ today
+6
Created
7mo

Ranking data as of October 21, 2026 (UTC).

Star History

Today, hour by hour

1,733 stars
06

Overview

Unified, efficient, and easy-to-use inference infrastructure for edge AI || 面向端侧 AI 的统一、高效、易用的推理基础设施 It ranks #36 on GitTiger, gaining +6 stars on October 21, 2026 (UTC).

The project is written in Rust and has 12 forks. It was created 7mo ago.

Installation
git clone https://github.com/omnimind-ai/OmniInfer.git
cd OmniInfer
# see README for setup