optillm
Optimizing inference proxy for LLMs
- agent
- agentic-ai
- agentic-workflow
- agents
- api-gateway
- genai
- large-language-models
- llm
- llm-inference
- llmapi
- mixture-of-experts
- moa
- openai
- openai-api
- optimization
- Stars
- 4,327
- Forks
- 394
- + today
- +1
- Created
- 2y
Ranking data as of October 21, 2026 (UTC).
Star History
Today, hour by hour
01
Overview
Optimizing inference proxy for LLMs It ranks #641 on GitTiger, gaining +1 star on October 21, 2026 (UTC).
The project is written in Python and has 394 forks. It was created 2y ago.
Installation
git clone https://github.com/algorithmicsuperintelligence/optillm.git
cd optillm
# see README for setup