原帖内容

Today has been one of the biggest days for open-source AI this year... and it keeps getting better. @PrismML just released more Ternary Bonsai 2 models on Hugging Face: now in 2B, 4B, 9B, and 27B. The 2B reaches up to 500 tok/s on my M4 Max ENTIRELY in the browser with custom WebGPU kernels... that's insane! 🤯 At ~1.8 bits per weight, the language-model weights are just 430MB for 2B and 950MB for 4B (plus ~365MB for the 8-bit vision weights). The future of local agentic AI is going to be wild. Try out the demo yourself 👇