Bonsai

#11 v Small & Edge modely

prismml · od März 2026 · 5× · naposledy 30. 6. 2026

24

Momentum

Bonsai is a family of 1-bit large language models from PrismML optimized for extremely efficient inference on edge devices. The flagship Bonsai 8B compresses 8.2 billion parameters into 1.15 GB of memory while achieving benchmark scores comparable to standard 8B models. The family uses a proprietary 1-bit architecture where each weight is stored as a binary value ({−1, +1}) with shared scaling factors, achieving a 14-fold reduction in memory requirements compared to 16-bit models.

Zdroje (5)