seuros

Model Dispatch and Memory Allocator: an LLM inference engine for the hardware you own. Hand-written CPU, ROCm, Vulkan, CUDA, Metal and Level Zero kernels, exact memory admission, mTLS gRPC and private federation.