Developer · Repository owner

synchopate

1 repository by synchopate on GitTiger, with 1 stars gained today.

Owner profile

synchopate

stars today

3993

synchopate/nemotron-30b-cpu-256k

Running a 30B MoE LLM on CPU at 30-50+ tok/s with a 256K Context Window via Hybrid Mamba-2 SSM, L3 NTA Slicing, AVX-512 VNNI Tile Repacking & 2MB HugePages

C++Local LLMsLLM Inference & Serving

4 forks

today

Repository rows keep their global rank; this list is filtered to the selected owner.