PrismML 发布 Bonsai 2 27B：可运行于消费级硬件的紧凑模型

UPDATED 12:10 EDT / SEPTEMBER 18 2026 AI PrismML launches Bonsai 2 27B, a high-intelligence AI model so small it fits on consumer hardware by Kyt Dotson Prism ML Inc. announced Thursday the launch of Bonsai 2 27B, the second generation of its ultra-compact multimodal generative artificial intelligence small enough to fit on PCs and some high-end mobile devices. The company said it used ternary, which uses three parts, to scale down its Qwen3.8 27B-based model. Qwen3.8 weighs around 56 gigabytes at its full 16-bit uncompressed size, and Bonsai 2 reduces it to around 5.9 gigabytes while retaining around 98.2% of its capabilities. Although it is possible to shrink AI models using other compression techniques called quantization, these methods usually strip away accuracy, knowledge and other systematic capabilities. Qwen3.8’s minimal memory footprint is around 9.4 gigabytes. Ternary provides an interesting compression method when shrinking the “weights,” or parameters that make up the model. Weights are the model’s numerical dials that control how it processes information and generates outputs. In full-size models, these are represented by 16 bits; with PrismML’s approach, these are simplified down to ternary, or three bits, represented by +1, 0, and -1. This lets the company store information in a much smaller memory footprint while still holding onto reasonably high intelligence. In essence, this allows Bonsai 2 to punch well above its weight class at a very small size. On benchmarks, Bonsai 2 showed close performance on agentic and tool calling compared to Qwen3.8 within 3 points, at 77.6 and 79.8 respectively; with aggregate scores of 81.6 and 82.2 for coding across HumanEval+, LiveCodeBench v6, MBPP+ and BigCodeBench; and 82.7 and 81.3 for knowledge and reasoning across MMLU-Redux, GPQA Diamond and AA-LCR. The model can run on an Nvidia GeForce GTX 5090 card without quantization, reaching 143 tokens per second and 46.8 tokens per second on Apple Inc.’s M5 Max chip. The company said the model consumes extremely low power per token at 0.714 megawatt-hours, making it 40% more energy-efficient than other 8B models running at full precision, meaning uncompressed. Ultra-small models let users run AI locally on their own machines without sending inference to the cloud. Any time data is sent across the internet, there can be a delay in receiving a response, or sensitive information might be sent to a third party. Bringing intelligence onto a local machine eliminates third-party data sharing, keeps prompts and responses local, helps meet strict privacy regulations, and can improve security. For example, simple translation, summarization, and search organization could run on device, while long-horizon task comprehension and research might need to be sent to an expensive cloud model. For an everyday user, or even an enterprise use case, running a local model that is far less expensive and respects privacy when a task is simple and involves sensitive information, while scaling up to highly intelligent, cloud-based models to handle complex, high-touch, goal-oriented work. The new model runs on Nvidia graphics processing units via CUDA and on Apple devices, including Mac, iPhone and iPad, via MLX, through low-bit kernels. Model weights are available today under Apache 2.0 licenses. Image: Pixabay A message from John Furrier, co-founder of SiliconANGLE: Support our mission to keep content open and free by engaging with theCUBE community. Join theCUBE’s Alumni Trust Network, where technology leaders connect, share intelligence and create opportunities. 15M+ viewers of theCUBE videos, powering conversations across AI, cloud, cybersecurity and more 11.4k+ theCUBE alumni — Connect with more than 11,400 tech and business leaders shaping the future through a unique trusted-based network Are you an AWS customer?  Support SiliconANGLE financially by buying your AWS services from our Marketplace portal page and links: https://siliconangle.com/aws-marketplace/ About SiliconANGLE Media SiliconANGLE Media is a recognized leader in digital media innovation, uniting breakthrough technology, strategic insights and real-time audience engagement. As the parent company of SiliconANGLE, theCUBE Network, theCUBE Research, CUBE365, theCUBE AI and theCUBE SuperStudios — with flagship locations in Silicon Valley and the New York Stock Exchange — SiliconANGLE Media operates at the intersection of media, technology and AI. Founded by tech visionaries John Furrier and Dave Vellante, SiliconANGLE Media has built a dynamic ecosystem of industry-leading digital media brands that reach 15+ million elite tech professionals. Our new proprietary theCUBE AI Video Cloud is breaking ground in audience interaction, leveraging theCUBEai.com neural network to help technology companies make data-driven decisions and stay at the forefront of industry conversations. LATEST STORIES For AI agents, it's the best of times, it's the worst of times What to expect from theCUBE's analysis of Dreamforce: Tune in Sept. 25 Full speed ahead: Despite calls to slow AI down, its support structure is on the fast track Tokenized stock trading is about to take off after SEC issues five-year exemption from securities laws AI data center builder Crusoe valued at $30.9B in $3.9B round Anthropic details practical metrics to help monitor the speed of AI development LATEST STORIES For AI agents, it's the best of times, it's the worst of times AI - BY ROBERT HOF . 2 HOURS AGO What to expect from theCUBE's analysis of Dreamforce: Tune in Sept. 25 CLOUD - BY VICTORIA GAYTON . 2 HOURS AGO Full speed ahead: Despite calls to slow AI down, its support structure is on the fast track INFRA - BY MARK ALBERTSON . 13 HOURS AGO Tokenized stock trading is about to take off after SEC issues five-year exemption from securities laws EMERGING TECH - BY MIKE WHEATLEY . 15 HOURS AGO AI data center builder Crusoe valued at $30.9B in $3.9B round INFRA - BY MARIA DEUTSCHER . 15 HOURS AGO Anthropic details practical metrics to help monitor the speed of AI development AI - BY MIKE WHEATLEY . 16 HOURS AGO