Beamivalice

Model · Image and text to text

Qwen3.8-Flash-Next-Sushi-4bpw

Beamivalice

Qwen/Qwen3.8-Flash-Next packed for sushi, a native inference engine for Apple Silicon. Sushi-3bpw there. sushi only. This pack needs sushi v1.0.0 or later on Apple Silicon with macOS 26.2 or later. It does not load in transformers, vLLM, mlx-lm or exllamav3. - MTP (the model's own draft head) and the 8-bit KV cache are on by default; --mtp-head-kv-quant stores the MTP head's own KV at 8 bits too. - A browser download of the binary is quarantined by macOS: clear it with xattr -dr com.apple.quarantine sushi-macos-arm64. By default a draft token is kept only when it is exactly what the model would have sampled. Add --mtp-typical 0.2 to also keep drafts the model finds likely enough: sampled…

Model · Image and text to text

Qwen3.8-Flash-Next-Sushi-3bpw

Beamivalice

Qwen/Qwen3.8-Flash-Next packed for sushi, a native inference engine for Apple Silicon. Target: a 64 GB Mac. On 96 GB and 128 GB Macs it runs the full 1M-token context. sushi only. This pack needs sushi v1.0.0 or later on Apple Silicon with macOS 26.2 or later. It does not load in transformers, vLLM, mlx-lm or exllamav3. - --kv-quant 8 keeps the KV cache at 8 bits, and --mtp-head-kv-quant does the same for the MTP head's own KV. - --prefill-chunk 2048 caps the prompt tokens forwarded per step, which keeps the prefill peak small. - --prefix-cache-disk 10GB keeps up to 10 GB of seen prompt prefixes on the SSD, so a repeated prompt skips its prefill, across restarts too. - MTP (the model's own…