Best AI News today

PrismML — AI News Today

United States flagUnited States

PrismML — the startup behind ternary-weight compression of open models for on-device inference. Its Ternary Bonsai 2 27B (September 2026) fits a 27B-parameter model into 5.93 GB, and it brings tiny LLMs to Qualcomm-powered smart glasses.

Models:Bonsai 2LLM

26 stories mentioning PrismML

searching across sources…

About PrismML

PrismML is an AI company. PrismML — the startup behind ternary-weight compression of open models for on-device inference. Its Ternary Bonsai 2 27B (September 2026) fits a 27B-parameter model into 5.93 GB, and it brings tiny LLMs to Qualcomm-powered smart glasses. This page tracks 26 recent news stories about PrismML, curated from 30+ sources and updated every 15 minutes.

PrismML — Coverage Momentum

0
This month
↓100%
vs last month
28
All-time
Sep 2026
Peak month
1
2
8
0
11
0
MayJunJulAugSepOct

First tracked Mar 2026. Most-citing sources: r/LocalLLaMA (13), Medium (5), Marktechpost (4), TechCrunch AI (2). Data aggregated by Best AI News Today from 30+ sources.

26 stories
Top StoryResearch

PrismML Releases Ternary Bonsai 2 27B: A 5.9 GB Apache 2.0 Model Retaining 98.2% of Qwen3.8 27B Performance

PrismML has released Ternary Bonsai 2 27B, a ternary-weight version of Qwen3.8 27B. The language model occupies 5.93 GB, against 53.80 GB in FP16. PrismML reports that it keeps 98.2% of the parent...

Marktechpost faviconMarktechpost·
RelatedQwen 3.8Bonsai 2

2 sources

r/LocalLLaMA faviconr/LocalLLaMA
A 27B model in 5.95 GB: where the 1.75 bits go, and what the smallest file costs you
Media

A 27B model in 5.95 GB: where the 1.75 bits go, and what the smallest file costs you

by Miles Builds — PrismML’s ternary Qwen3.8 27B ships as two files. The smaller one is slower, and the model card says why.

Medium faviconMedium·
RelatedQwen 3.8
Media

I Measured Prism ML’s Bonsai 2 Against My Own Builds of Alibaba’s Qwen3.8–27B.

36 tokens per second in about 10 GB on an M4 Max, the same test scores as a 4-bit build twice its size, and five traps that nearly skewed… Continue reading on Data Science Collective »

Medium · Manjunath Janardhan faviconMedium · Manjunath Janardhan·
What is Bonsai 2? Why a 27B Model Now Fits on the Laptop You Already Own
Media

What is Bonsai 2? Why a 27B Model Now Fits on the Laptop You Already Own

by Levent Bulusan — PrismML crushed Qwen3.8 27B from 53.8 GB down to 5.9 GB and kept 98.2% of it. Here’s what that actually feels like, and where it quietly…

Medium faviconMedium·
Discussions

Bonsai-27B & Ternary-Bonsai-27B - Updates (on PRs)

Below Upstream Status sections are from https://github.com/PrismML-Eng/Bonsai-demo Upstream Status for Binary Q1_0 is supported out of the box in upstream llama.cpp across many backends: CPU...

r/LocalLLaMA faviconr/LocalLLaMA·
Discussions

Bonsai 27B: 1-bit dense LLM running locally in your browser using custom WebGPU kernels

Very impressive release by the PrismML team. 1-bit quantization shrinks it from 54GB to just 3.8GB (-93%), while retaining 90% of its intelligence. - Collection on Hugging Face:...

r/LocalLLaMA faviconr/LocalLLaMA·
Discussions

1-bit Bonsai Image 4B and Ternary Bonsai Image 4B Image Generation for Local Devices with just 0.93 GB and 1.21 GB respectively of Diffusion Transformer Footprint. So tiny!

https://prismml.com/news/bonsai-image-4b

r/LocalLLaMA faviconr/LocalLLaMA·
Bonsai 2 Is Here: The 5.9 GB 27B Model Now Keeps 98% of Its Parent’s Score
Media

Bonsai 2 Is Here: The 5.9 GB 27B Model Now Keeps 98% of Its Parent’s Score

by Kristopher Dunham — Two months after the first Bonsai 27B, PrismML’s sequel closes most of the quality gap, changes which tools can run it, and makes the old…

Medium faviconMedium·
RelatedBonsai 2
Bonsai 2 27B: How a 27B AI Model Fits Into a 5.9 GB Footprint ⚡
Media

Bonsai 2 27B: How a 27B AI Model Fits Into a 5.9 GB Footprint ⚡

by Greek Ai — PrismML compressed Qwen3.8 27B into a ternary model that retains 98.2% of the parent model’s benchmark score

CodeToDeploy faviconCodeToDeploy·
Research

Deploying a 1-Bit Bonsai-27B Model with PrismML llama.cpp and OpenAI-Compatible Local Inference Workflows

In this tutorial, we deploy the 1-bit Bonsai-27B language model using the PrismML fork of llama.cpp, which provides the specialized CUDA kernels required to decode the model’s Q1_0_g128 GGUF...

Marktechpost faviconMarktechpost·
Discussions

Apple in talks with startup PrismML that shrinks AI models to run on an iPhone

r/LocalLLaMA faviconr/LocalLLaMA·
Related Apple
Discussions

PrismML’s new Ternary Qwen3.6 27B runs near fp16 precision on 10GB of memory!!!

EDIT: "near fp16 precision" I intended performance in terms of benchmarks/output. Obviously 1,0,-1 cannot be fp16. Bad word choice :) EDIT 2: Now that more people have tested it reported in,...

r/LocalLLaMA faviconr/LocalLLaMA·
Discussions

Welcome to June 1, 2026 - Dr. Alex Wissner-Gross

https://preview.redd.it/5mwgrhzcvp4h1.png?width=1983&format=png&auto=webp&s=59896f5311807dbdb86406e6e48709fd6a4d6e9d The Singularity is learning to fit in your pocket. PrismML released Bonsai Image...

r/accelerate faviconr/accelerate·
Your Smart Glasses Don’t Need the Cloud Anymore
Media

Your Smart Glasses Don’t Need the Cloud Anymore

by Satyam Sahu — PrismML’s 2-billion-parameter 1-bit Bonsai model moves vision, memory and reasoning onto the device itself, and shows why quantization…

Medium faviconMedium·
PrismML Shrunk a 27B Open Model to 5.9 GB and Kept 98% of the Benchmarks
Media

PrismML Shrunk a 27B Open Model to 5.9 GB and Kept 98% of the Benchmarks

by Aaron Harme — Bonsai 2 compresses Alibaba’s Qwen3.8 with ternary weights so the model can fit on a PC and, maybe, a high-end phone

All My Circuits faviconAll My Circuits·
Discussions

Bonsai 27B runs locally on an iPhone - a 27B model in 3.9GB

PrismML built Bonsai on top of Qwen3.6-27B by quantizing the weights down to 1-bit. That takes it from ~54GB to 3.9GB, small enough to fit and run on a phone, while keeping ~90% of the benchmark...

r/LocalLLaMA faviconr/LocalLLaMA·
Research

PrismML Releases Bonsai 27B: 1-bit and Ternary Builds of Qwen3.6-27B That Run on Laptops and Phones

PrismML just released Bonsai 27B. It is a low-bit representation of Qwen3.6-27B, not a new pretrain. The architecture is unchanged. Two variants ship under Apache 2.0. Ternary Bonsai 27B uses {−1, 0,...

Marktechpost faviconMarktechpost·
Discussions

Compressed Version of Qwen-3.6-27B coming from PrismML - Khosla-Backed Startup Claims Breakthrough With Largest-Ever AI Model on an iPhone

The startup, PrismML, said it has shrunk down Qwen 3.6, an open-source large language model developed by Chinese internet giant Alibaba, to run on an iPhone 17 Pro. The model has 27 billion...

r/LocalLLaMA faviconr/LocalLLaMA·
Discussions

PrismML just released Binary and Ternary Bonsai Image 4B: 1-bit/ternary text-to-image diffusion transformers that can even run 100% locally in your browser on WebGPU.

The PrismML team really cooked with these models. They're only ~3GB in size (compared to FLUX.2 Klein 4B, which is ~16GB). Apache-2.0! Official collection on HF:...

r/LocalLLaMA faviconr/LocalLLaMA·
RelatedFlux

Frequently Asked Questions

What is PrismML?

PrismML is PrismML — the startup behind ternary-weight compression of open models for on-device inference. Its Ternary Bonsai 2 27B (September 2026) fits a 27B-parameter model into 5.93 GB, and it brings tiny LLMs to Qualcomm-powered smart glasses.

What is the latest news about PrismML?

As of today, there are 26 recent stories about PrismML. Recent headlines include: A 27B model in 5.95 GB: where the 1.75 bits go, and what the smallest file costs you; Bonsai 2 Is Here: The 5.9 GB 27B Model Now Keeps 98% of Its Parent’s Score; Your Smart Glasses Don’t Need the Cloud Anymore. Updated every 15 minutes.