Skip to main content

Tag · 5 repos

quantization

Repositories carrying the quantization tag.

Exact tag match5 sample repositories
807
fermionresearch/phonon

Phonon: open speech recognition models (Phonon-2, Phonon-1) — CLI, CPU and CUDA images

PythonSpeech RecognitionLLM Inference & Serving
1246
Dreamer-Toby/STEPQuant

STEPQuant: When and Where Errors Matter in Delta-Rule Recurrent State Quantization

PythonLLM Inference & Serving
1773
sergmister/PromptMoGe

Metric depth from one RGB frame and a phone LiDAR: LiDAR-prompted MoGe-3 with real-time on-device models (Core ML + Metal)

PythonComputer VisionLocal LLMs
2661
hiyouga/LlamaFactory

Unified Efficient Fine-Tuning of 100+ LLMs & VLMs (ACL 2024)

PythonFine-tuning & TrainingLLM Inference & Serving
5263
htobty/ReadyLLM

Deploy, monitor, and tune LLM through a visual interface — plus image / video generation on top of ComfyUI.

PythonLocal LLMsLLM Inference & Serving