Ternary (1.58-bit) language model in GGUF Q20 format for llama.cpp - Demo repo — examples for serving, benchmarking, and integrating Bonsai - Discord — community support and updates Each weight takes a value from {-1, 0, +1}, with one shared FP16 scale per group of 128 weights: Q20 encodes each weight as a 2-bit code q in {0, 1, 2, 3}, dequantized via w = (q - 1) scale. One 128-element block is 34 bytes (2 bytes FP16 scale + 32 bytes of packed 2-bit codes) for an effective 2.125 bits/weight. The fourth code point (q = 3, reconstructing to +2 scale) is reserved for future extensions; for ternary weights it is unused. Evaluated with EvalScope v1.4.2 + vLLM 0.15.1 on NVIDIA H100 under…
Open weights
apache-2.0
gguf
End-to-end 1-bit language model for llama.cpp (CUDA, Metal, CPU) - 1.15 GB parameter memory (down from 16.38 GB FP16) — fits on virtually any device with a GPU - End-to-end 1-bit weights across embeddings, attention projections, MLP projections, and LM head - GGUF Q10 (g128) format with inline dequantization kernels — no FP16 materialization - Google Colab — try Bonsai in your browser, no setup required - Whitepaper — for more details on Bonsai, check out our whitepaper - Demo repo — comprehensive examples for serving, benchmarking, and integrating Bonsai - Discord — join the community for support, discussion, and updates - 1-bit kernels: llama.cpp fork (CUDA + Metal) · MLX fork (Apple…
Open weights
apache-2.0
llama.cpp
The voice of an AI, written down and checkable. voaice is the voice stack of mindX: speech in, speech out, measured throughout. It gives a machine a voice, says the realm's names the way their owners say them, and proves which voice made a recording. This repository is voaice's voice library: 70 open-licensed Piper voices in 29 language families (4.62 GB), kept here so a mindX node holds only the voices it speaks with and fetches any other on demand. The voices in piper/ are here for anyone to use: download one, run it with Piper, build on it. Each voice keeps its own open licence, the licence of the dataset its speakers recorded, and the folder's official licences list every voice under…
Open weights
other
piper
