Developer · Repository owner

kael-odin

1 repository by kael-odin on GitTiger, with 1 stars gained today.

Owner profile

kael-odin

stars today

2195

kael-odin/2080ti-22G-kvmem-qwen3.8-27B-256K-36.6toks

Best single-card local long-context solution for an RTX 2080 Ti 22G (sm_75): KVMem mainline with 262K context and measured 36.6 tok/s (IQ3+MTP+vision), lossless streaming KV backup, and complete source reproduction chain plus build, patch, and test tools.

PythonLLM Inference & ServingLocal LLMs

1 forks

today

Repository rows keep their global rank; this list is filtered to the selected owner.