llama-cpp-bonsai
llama.cpp fork for Ternary Bonsai 2 27B: MTP speculation, suffix cache reuse (SCR), q8 KV, two-slot fairness, fused DeltaNet kernels
Star 1
Fork 0
Watch
1bitbr.at

Starred