Precision Numerics releases Boole-1.7B, a 247MB open-weight 1-bit quantization of Qwen3-1.7B (per community post)
Verified (fact)
According to a Reddit r/LocalLLaMA post, Precision Numerics released Boole-1.7B, a 1-bit version of Qwen3-1.7B, as its first release. The compressed weights are 247MB, 1/13.9 the size of BF16. It can run locally in a browser and can also be used with vLLM and llama.cpp. It is intended for low-latency tasks in English and non-thinking mode.
Needs fact-check (claim)
The company claims that on its own 10-task evaluation it retains 85.9% of the BF16 model's average score, beating the 1-bit Bonsai-1.7B and nearly matching the 1.58-bit Bonsai-1.7B.
Why it matters (interpretation)
As near-1-bit quantization approaches practical performance on small models, options for running LLMs in browsers and on edge devices are widening.
Confidence medium · official source pending
Sources
- Community Boole-1.7B: A 1-bit Qwen3-1.7B model that outperforms Bonsai-1.7B Reddit