Skip to main content

Tag · 5 repos

on-device-ai

Repositories carrying the on-device-ai tag.

Exact tag match5 sample repositories
575
cactus-compute/needle

Automation foundation model for tiny devices: 2-bit, 8-29 MB, tool calls, structured extraction and embeddings on phones, wearables, smart homes, robots, cars and microcontrollers.

PythonLocal LLMsOCR & Document AI
925
nobodywho-ooo/nobodywho

NobodyWho is an inference engine that lets you run LLMs locally and efficiently on any device.

RustMobile & Desktop AppsLLM Inference & Serving
1773
sergmister/PromptMoGe

Metric depth from one RGB frame and a phone LiDAR: LiDAR-prompted MoGe-3 with real-time on-device models (Core ML + Metal)

PythonComputer VisionLocal LLMs
2491
rayl15/OpenVision

Open-source iOS app connecting Meta Ray-Ban smart glasses to AI — 5 backends (on-device MLX models, Apple Intelligence, OpenAI, Gemini Live, OpenClaw), on-device neural voice, face recognition & live web search. Private and offline-capable.

SwiftLocal LLMsMobile & Desktop Apps
3615
jegly/OfflineLLM

Private on-device AI chat for Android — runs any GGUF model locally via llama.cpp with ARM-optimised SIMD. Zero network permissions, encrypted settings, biometric lock, tamper detection. + GPU Acceleration

KotlinLocal LLMsMobile & Desktop Apps