Releases·Model Release
Prism ML releases Ternary Bonsai 2, a 27B ternary-weight model under 6GB that runs in-browser on WebGPU
Prism ML released Ternary Bonsai 2 on Hugging Face, a 27B model using ternary weights to shrink to under 6GB. Derived from Qwen3.8-27B with architecture unchanged, it is 9x smaller than FP16 while retaining 98.2% of its intelligence, and can run in-browser via WebGPU. This makes a large hybrid-attention model practical for fully local, client-side inference.
1870 engagement1 sourceThu, Sep 17, 2026, 09:05 PM
AI Overview
- Ternary Bonsai 2 derives from Qwen3.8-27B, a 27B hybrid-attention causal LM, keeping the architecture unchanged while using ternary weights
- Model card claims the ternary weights make it 9x smaller than FP16 while retaining 98.2% of the intelligence
- Prism ML hosts the model in a Hugging Face collection with a WebGPU kernels demo Space (webml-community/ternary-bonsai-2-webgpu-kernels)
Related
Releases·Model Releasefeatured
PrismML releases Bonsai 27B, a 1-bit quantized 27B-parameter LLM that runs on a phone
PrismML released Bonsai 27B, a 1-bit quantized version of Qwen3.6 27B that shrinks from 54GB to 3.8GB while retaining 90% of benchmark performance. It is the first 27B-class model capable of running locally in a browser or on a smartphone via custom WebGPU kernels, enabling on-device inference without cloud dependency.
PrismML released Bonsai 27B, a 1-bit quantized version of Qwen3.6 27B that shrinks from 54GB to 3.8GB while retaining 90% of benchmark performance. It is the first 27B-class model capable of running locally in a browser or on a smartphone via custom WebGPU kernels, enabling on-device inference without cloud dependency.
Updated Fri, Jul 24, 2026, 07:02 PM — Bonsai 27B now runs on iPhone (3.9GB) and in browser via WebGPU; Ollama desktop app released July 24.
5413.2k engagement10 sourceshackernews, reddit, rss +1Tue, Jul 14, 2026, 05:50 PM
Social·Community
UkisAI proposes Swifted Ternary Bonsai 2 27B to cut overthinking loops; Swift Qwen3.8 downloads hit 150k
UkisAI's Jovan asked r/LocalLLaMA whether users want a 'Swift' variant of Ternary Bonsai 2, saying testing shows the model suffers from overthinking loops and high token usage. The team behind Swift Qwen3.8 27B is asking which quantization sizes (1-bit, 2-bit, or both) to build. Swift Qwen3.8 downloads jumped from 100k to 150k overnight, and Bonsai 2 was created by another team.
UkisAI's Jovan asked r/LocalLLaMA whether users want a 'Swift' variant of Ternary Bonsai 2, saying testing shows the model suffers from overthinking loops and high token usage. The team behind Swift Qwen3.8 27B is asking which quantization sizes (1-bit, 2-bit, or both) to build. Swift Qwen3.8 downloads jumped from 100k to 150k overnight, and Bonsai 2 was created by another team.
318 engagement1 sourceredditFri, Sep 18, 2026, 12:04 PM
Products·building
Mentria.ai: browser-based WebGPU inference engine running 1-bit 27B LLMs locally
A solo-built browser inference engine written from scratch in WebGPU/WGSL that runs the Bonsai-27B natively 1-bit model at 25-30 tokens/s on a 6 GB RTX 3060 Laptop, entirely in Chrome. It solves the problem of running large LLMs locally with no install, no server, and no data leaving the machine. Targets users with modest consumer GPUs.
A solo-built browser inference engine written from scratch in WebGPU/WGSL that runs the Bonsai-27B natively 1-bit model at 25-30 tokens/s on a 6 GB RTX 3060 Laptop, entirely in Chrome. It solves the problem of running large LLMs locally with no install, no server, and no data leaving the machine. Targets users with modest consumer GPUs.
87 engagement1 sourceredditWed, Sep 9, 2026, 01:49 PM
Releases·Model Release
Show HN: Boole-1.7B, a 1-bit LLM that outperforms Bonsai-1.7B
Precision Numerics released Boole-1.7B, a 1-bit quantized version of Qwen3-1.7B, with open weights on Hugging Face and a browser chat demo. The model retains 85.9% of BF16 performance in a 247MB footprint, outperforming 1-bit Bonsai-1.7B. It targets practitioners running small English-language, non-thinking models on constrained hardware.
Precision Numerics released Boole-1.7B, a 1-bit quantized version of Qwen3-1.7B, with open weights on Hugging Face and a browser chat demo. The model retains 85.9% of BF16 performance in a 247MB footprint, outperforming 1-bit Bonsai-1.7B. It targets practitioners running small English-language, non-thinking models on constrained hardware.
146 engagement2 sourceshackernews, redditMon, Oct 12, 2026, 03:49 PM
Releases·Model Release
Ternary Bonsai 2 (2B, 4B, and 9B) just released on Hugging Face. The 2B can run entirely locally in the browser at up to 500 tok/s on an M4 Max with custom WebGPU kernels.
Prism ML released the Ternary Bonsai 2 family in 2B, 4B, and 9B sizes on Hugging Face, based on Qwen 3.5. The 2B model runs entirely in the browser at up to 500 tok/s on an M4 Max using custom WebGPU kernels, with a live WebGPU demo available. The models currently require Prism ML's fork of llama.cpp rather than vanilla llama.cpp.
Prism ML released the Ternary Bonsai 2 family in 2B, 4B, and 9B sizes on Hugging Face, based on Qwen 3.5. The 2B model runs entirely in the browser at up to 500 tok/s on an M4 Max using custom WebGPU kernels, with a live WebGPU demo available. The models currently require Prism ML's fork of llama.cpp rather than vanilla llama.cpp.
187 engagement2 sourcesredditThu, Oct 15, 2026, 08:09 PM