SAVRN
Search Contact SAVRN

Open-weight model · Text to audio

stable-audio-3-optimized

by Stability AI stabilityai/stable-audio-3-optimized

stable-audio-3-optimized is an open-weight model for text to audio from Stability AI, released under other. Its published files total 160.0 GB. It draws 39k downloads a month.

Please note: For commercial use, please refer to https://stability.ai/license Stable Audio 3 is a family of fast latent diffusion models (small, medium, large) for variable length audio generation and editing.

Parameters—
Context—
Weights84.4 GB
Licenseother
AccessOpen weights
Monthly Downloads39k

Model Card

Please note: For commercial use, please refer to https://stability.ai/license Stable Audio 3 is a family of fast latent diffusion models (small, medium, large) for variable length audio generation and editing. Since our models can generate several minutes of audio, variable-length generations are key to avoid the cost of producing full-length generations for short sounds. We also support inpainting, enabling targeted audio editing and the continuation of short recordings. Our latent diffusion models operate on top of a novel semantic-acoustic autoencoder that projects audio into a compact latent space, enabling efficient diffusion-based generation while preserving audio fidelity and…

Excerpt from the card by Stability AI, licensed other.

Identity and Version

Repository
stabilityai/stable-audio-3-optimized
Publisher
Stability AI
Task
Text to audio
Modality
Other
Library
stable-audio-3
Parameters
Not stated by the source
Languages
en
Revision
91ec8536bd25191cc0cd10fea1a84de0597faf30
First published
2026-05-18
Last updated
2026-10-10

Files and Weights

184 files, 160.0 GB in total. The weights are 96 files totalling 84.4 GB in bin, npz, onnx, tflite.

Weights96 files · 84.4 GB
Tokenizer3 files · 73.0 MB
Documentation8 files · 72.7 KB
Other76 files · 75.6 GB
Repository1 file · 2.9 KB
Every file
FileTypeSizeSHA-256
MLX/dit_medium-base_f16.npzWeights2.9 GB cb829e33d7e6
MLX/dit_medium_f16.npzWeights2.9 GB f9e5647ea322
MLX/dit_sm-music-base_f16.npzWeights918.8 MB 4a8ee6dc2f5e
MLX/dit_sm-music_f16.npzWeights919.2 MB 8ed3f38e2597
MLX/dit_sm-sfx-base_f16.npzWeights918.8 MB 587e1b0bb4b9
MLX/dit_sm-sfx_f16.npzWeights919.2 MB 7e702d264069
MLX/same_l_decoder_f32.npzWeights1.7 GB 84924be2122d
MLX/same_l_encoder_f32.npzWeights1.7 GB c5caafc6bd29
MLX/same_s_decoder_f32.npzWeights218.1 MB 909928a8e693
MLX/same_s_encoder_f32.npzWeights214.9 MB a48f80d81c30
MLX/t5gemma_f16.npzWeights567.4 MB 8deb20489f36
cpu-amx/dit_medium_bf16_core.binWeights2.7 GB 90054e14ef18
cpu-amx/dit_medium_bf16_pin_fp32.npzWeights1.6 MB e9a8bf789097
cpu-amx/dit_medium_int8_core.binWeights1.5 GB 13dc7d122d88
cpu-amx/same_l_decoder_bf16_weights.binWeights852.5 MB 8945034f5c22
cpu-amx/same_l_decoder_int8_weights.binWeights427.7 MB 3c1026f5c827
cpu-amx/same_l_encoder_bf16_weights.binWeights852.5 MB 49482e2a8f91
cpu-amx/same_l_encoder_bf16_weights_f32.binWeights1.7 GB 297aa69ee0c1
cpu-amx/same_l_encoder_int8_weights.binWeights427.7 MB cb6f41c187f3
cpu-amx/same_s_decoder_bf16_weights.binWeights109.1 MB 2a1b60e9e718
cpu-amx/same_s_decoder_int8_weights.binWeights54.9 MB af4667431a37
cpu-amx/same_s_encoder_bf16_weights.binWeights107.6 MB e0983f9041f3
cpu-amx/same_s_encoder_int8_weights.binWeights54.1 MB 1ae2f67d10ca
cpu-amx/t5gemma_bf16_weights.binWeights563.2 MB f8302b5b785f
onnx/sa3-m/dit.onnxWeights3.9 MB 369ed7fa4cc0
onnx/sa3-m/dit_bf16.onnxWeights4.8 MB c70d3e0db208
onnx/sa3-m/dit_fp16.onnxWeights4.2 MB ede6d4f1a618
onnx/sa3-m/dit_fp8.onnxWeights9.3 MB 00e993d51ee2
onnx/sa3-sm-music/dit.onnxWeights1.8 GB 196e4af5f577
onnx/sa3-sm-music/dit_fp16.onnxWeights921.1 MB 86fd5780edfb
onnx/sa3-sm-music/dit_fp8.onnxWeights2.6 MB dbba40f6fea1
onnx/sa3-sm-sfx/dit.onnxWeights1.8 GB a4d4ef70791d
onnx/sa3-sm-sfx/dit_fp16.onnxWeights921.1 MB 8154582d5c8e
onnx/sa3-sm-sfx/dit_fp8.onnxWeights2.6 MB b0aa299374c9
onnx/same-l/dec_fp16.onnxWeights1.2 GB 3f76e79f27e5
onnx/same-l/dec_fp16_limiter.onnxWeights1.2 GB 34430154574e
onnx/same-l/dec_fp8.onnxWeights937.7 MB 29fc3f082b18
onnx/same-l/dec_fp8_limiter.onnxWeights937.7 MB cd2cb629f7ab
onnx/same-l/enc_fp16.onnxWeights1.2 GB e4c8d0c95351
onnx/same-l/enc_fp8.onnxWeights937.7 MB 0a1815911f5b
onnx/same-l/legacy/dec_w8_bf16.onnxWeights938.1 MB 004f4018dec6
onnx/same-l/legacy/enc_w8_bf16.onnxWeights938.1 MB 611a794c7f3f
onnx/same-s/dec_bf16.onnxWeights218.7 MB ba1e92f888e4
onnx/same-s/dec_bf16_limiter.onnxWeights218.7 MB 995d40d56e16
onnx/same-s/dec_fp8.onnxWeights59.1 MB 48b731585b58
onnx/same-s/dec_fp8_limiter.onnxWeights59.1 MB 6cb326e46ee1
onnx/same-s/enc_bf16.onnxWeights215.5 MB 87217e0a068f
onnx/same-s/enc_fp8.onnxWeights55.9 MB 311026a29877
onnx/same-s/legacy/dec_fp8_fast.onnxWeights59.1 MB 01821906a02c
onnx/same-s/legacy/dec_w8_bf16.onnxWeights59.2 MB 36434e7c683c
onnx/same-s/legacy/enc_fp8_fast.onnxWeights56.0 MB 933ec720cac5
onnx/same-s/legacy/enc_w8_bf16.onnxWeights56.0 MB f4b63351f35f
onnx/t5gemma/encoder.onnxWeights620.4 MB dc79684b14c9
tflite/sa3-m/dit_fp32.tfliteWeights5.8 GB 3a8b2080436c
tflite/sa3-m/dit_w8a8.tfliteWeights1.7 GB e60ea3a8b530
tflite/sa3-m/legacy/dit_fp32.tfliteWeights5.8 GB b811dc7d0135
tflite/sa3-m/legacy/dit_w16a32.tfliteWeights2.9 GB 25668de768e5
tflite/sa3-m/legacy/dit_w8a32.tfliteWeights1.5 GB 11bed4d4ea32
tflite/sa3-m/legacy/dit_w8a8-dyn.tfliteWeights1.5 GB 3feea38f595c
tflite/sa3-sm-music/dit_fp32.tfliteWeights1.8 GB 3fd214377c48
tflite/sa3-sm-music/dit_w8a8.tfliteWeights539.4 MB 1d8ef99bf10f
tflite/sa3-sm-music/legacy/dit_fp32.tfliteWeights1.8 GB d388700a2ca4
tflite/sa3-sm-music/legacy/dit_w16a32.tfliteWeights921.4 MB f5faeb8a7718
tflite/sa3-sm-music/legacy/dit_w8a32.tfliteWeights467.1 MB 7ef2bffa087c
tflite/sa3-sm-music/legacy/dit_w8a8-dyn.tfliteWeights467.1 MB 489f30a65c5f
tflite/sa3-sm-sfx/dit_fp32.tfliteWeights1.8 GB 06ea22d57bd9
tflite/sa3-sm-sfx/dit_w8a8.tfliteWeights539.4 MB d3f99409f446
tflite/sa3-sm-sfx/legacy/dit_fp32.tfliteWeights1.8 GB 6060ecfeca34
tflite/sa3-sm-sfx/legacy/dit_w16a32.tfliteWeights921.4 MB adf477c417a2
tflite/sa3-sm-sfx/legacy/dit_w8a32.tfliteWeights467.1 MB 7a6c8c48233b
tflite/sa3-sm-sfx/legacy/dit_w8a8-dyn.tfliteWeights467.1 MB 9bae6401e925
tflite/same-l/dec_fp32.tfliteWeights1.8 GB f06a59343858
tflite/same-l/dec_w8a8.tfliteWeights515.4 MB 53dbca41ec96
tflite/same-l/enc_fp32.tfliteWeights1.7 GB 1560c83c097d
tflite/same-l/enc_w8a8.tfliteWeights466.8 MB 9c76149a2fe6
tflite/same-l/legacy/dec_fp32.tfliteWeights1.8 GB 3af34d35939c
tflite/same-l/legacy/dec_w16a32.tfliteWeights973.8 MB f96d463ddb12
tflite/same-l/legacy/dec_w8a32.tfliteWeights549.2 MB b70ed8c52cef
tflite/same-l/legacy/dec_w8a8-dyn.tfliteWeights549.2 MB 6d6b88b418e5
tflite/same-l/legacy/enc_fp32.tfliteWeights1.8 GB f8b5e95a7073
tflite/same-l/legacy/enc_w16a32.tfliteWeights972.2 MB a0a253c3c056
tflite/same-l/legacy/enc_w8a32.tfliteWeights549.2 MB 11632dcb1439
tflite/same-l/legacy/enc_w8a8-dyn.tfliteWeights549.2 MB 485e590782e9
tflite/same-s/dec_fp32.tfliteWeights246.1 MB b8b6730b542f
tflite/same-s/dec_w8a8.tfliteWeights89.3 MB 90cad5ef81e6
tflite/same-s/enc_fp32.tfliteWeights218.5 MB ebf2ac30d5c6
tflite/same-s/enc_w8a8.tfliteWeights64.0 MB d9f70cbd21f4
tflite/same-s/legacy/dec_fp32.tfliteWeights218.4 MB cd87fa6686b2
tflite/same-s/legacy/dec_w16a32.tfliteWeights111.8 MB bbed19f549dc
tflite/same-s/legacy/dec_w8a32.tfliteWeights55.7 MB be6ac0fa7770
tflite/same-s/legacy/dec_w8a8-dyn.tfliteWeights55.7 MB b477524497d9
tflite/same-s/legacy/enc_fp32.tfliteWeights215.2 MB 35ce38ea9f56
tflite/same-s/legacy/enc_w16a32.tfliteWeights107.8 MB fac08eb35be7
tflite/same-s/legacy/enc_w8a32.tfliteWeights54.9 MB 5ec992e6507b
tflite/same-s/legacy/enc_w8a8-dyn.tfliteWeights54.9 MB adcf9cdb17df
tflite/t5gemma/encoder_fp16.tfliteWeights563.8 MB 8530d0b3e6b9
LICENSE.mdDocumentation11.9 KB —
LICENSE_GEMMA.mdDocumentation10.5 KB —
MLX/README.mdDocumentation —
NOTICEDocumentation97 B —
README.mdDocumentation7.3 KB —
cpu-amx/README.mdDocumentation5.8 KB —
tensorRT/README.mdDocumentation10.0 KB —
tflite/README.mdDocumentation27.1 KB —
Stable_Audio_3.0_Thumbnail_1x1.pngOther1.5 MB a9834815023e
cpu-amx/dit_medium_bf16.soOther67.0 MB 722cc6db5bfc
cpu-amx/dit_medium_bf16_core_manifest.txtOther16.4 KB —
cpu-amx/dit_medium_bf16_flash.soOther691.6 KB 906ffc5a1f71
cpu-amx/dit_medium_int8.soOther67.0 MB 79a56abbb721
cpu-amx/dit_medium_int8_core_manifest.txtOther23.2 KB —
cpu-amx/dit_medium_int8_kernels.tar.gzOther1.2 MB 9669f5396d0c
cpu-amx/same_l_decoder_bf16.soOther67.0 MB 6890c90ba2f5
cpu-amx/same_l_decoder_bf16_weights_manifest.txtOther7.7 KB —
cpu-amx/same_l_decoder_int8.soOther29.4 MB b8b9ad2805d7
cpu-amx/same_l_decoder_int8_weights_manifest.txtOther9.5 KB —
cpu-amx/same_l_encoder_bf16.soOther29.4 MB 21c77188d4a6
cpu-amx/same_l_encoder_bf16_weights_f32_manifest.txtOther2.1 KB —
cpu-amx/same_l_encoder_bf16_weights_manifest.txtOther7.8 KB —
cpu-amx/same_l_encoder_int8.soOther29.4 MB 7b968ea6c44a
cpu-amx/same_l_encoder_int8_weights_manifest.txtOther9.5 KB —
cpu-amx/same_s_decoder_bf16.soOther67.0 MB 840396c782a7
cpu-amx/same_s_decoder_bf16_weights_manifest.txtOther3.7 KB —
cpu-amx/same_s_decoder_int8.soOther29.3 MB e66dfee72eaa
cpu-amx/same_s_decoder_int8_weights_manifest.txtOther4.6 KB —
cpu-amx/same_s_encoder_bf16.soOther29.3 MB 7ad21c5359e2
cpu-amx/same_s_encoder_bf16_weights_manifest.txtOther3.8 KB —
cpu-amx/same_s_encoder_int8.soOther29.3 MB b7bd1b29e883
cpu-amx/same_s_encoder_int8_weights_manifest.txtOther4.6 KB —
cpu-amx/t5gemma_bf16.soOther29.3 MB 953d56365b44
cpu-amx/t5gemma_bf16_weights_manifest.txtOther4.7 KB —
onnx/sa3-m/dit.onnx.dataOther5.8 GB 985989c387db
onnx/sa3-m/dit_fp16.onnx.dataOther2.9 GB a038ae6d82c4
onnx/sa3-m/dit_fp8lin.onnx.dataOther5.8 GB 593cf6bff9fe
onnx/sa3-sm-music/dit_fp8.onnx.dataOther918.8 MB 1231c4902cf2
onnx/sa3-sm-sfx/dit_fp8.onnx.dataOther918.8 MB 9d34ceb9efe1
tensorRT/sm_120/sa3-m/dit_fp16.trtOther2.9 GB ff6fdfa5f02f
tensorRT/sm_120/sa3-m/dit_fp32.trtOther5.8 GB caf0b4c767ea
tensorRT/sm_120/sa3-m/dit_fp8.trtOther1.5 GB c2613da5f8b5
tensorRT/sm_120/sa3-sm-music/dit_fp16.trtOther924.8 MB 5db04f5303fb
tensorRT/sm_120/sa3-sm-music/dit_fp32.trtOther1.8 GB 53fe25491a12
tensorRT/sm_120/sa3-sm-sfx/dit_fp16.trtOther924.8 MB e74cc523baf9
tensorRT/sm_120/sa3-sm-sfx/dit_fp32.trtOther1.8 GB b30e9a8f6fd5
tensorRT/sm_120/same-l/legacy/dec_dynamic_fp32.trtOther1.7 GB f53cb8168ac5
tensorRT/sm_120/same-l/legacy/dec_dynamic_triton_swa.trtOther1.2 GB e7b030cb0cf0
tensorRT/sm_120/same-l/legacy/dec_fp8.trtOther941.5 MB 63c1ec99ef49
tensorRT/sm_120/same-l/legacy/enc_dynamic_triton_swa.trtOther1.2 GB d48b4210bff7
tensorRT/sm_120/same-s/legacy/dec_dynamic_bf16.trtOther115.2 MB 5c9fb06d53e1
tensorRT/sm_120/same-s/legacy/dec_dynamic_fp32.trtOther225.1 MB 37dbbfe2467e
tensorRT/sm_120/same-s/legacy/dec_fp8.trtOther82.2 MB 67280d367d7e
tensorRT/sm_120/same-s/legacy/enc_dynamic_bf16.trtOther111.5 MB 6986ddfe6a06
tensorRT/sm_120/t5gemma/t5gemma_fp16.trtOther621.0 MB 4f8998e66943
tensorRT/sm_90/sa3-m/dit_fp16.trtOther2.9 GB d924c1fb8e0b
tensorRT/sm_90/sa3-m/dit_fp16_lora.trtOther3.0 GB 0cfd29df6d68
tensorRT/sm_90/sa3-m/dit_fp32.trtOther5.8 GB f6787419c134
tensorRT/sm_90/sa3-m/dit_fp8.trtOther1.5 GB 88e69eab8442
tensorRT/sm_90/sa3-sm-music/dit_fp16.trtOther935.6 MB bb7be6e8d743
tensorRT/sm_90/sa3-sm-music/dit_fp32.trtOther1.8 GB 35ea9b5f039a
tensorRT/sm_90/sa3-sm-music/dit_fp8.trtOther477.6 MB 962f775b96dc
tensorRT/sm_90/sa3-sm-sfx/dit_fp16.trtOther935.5 MB 1646a9d73ffe
tensorRT/sm_90/sa3-sm-sfx/dit_fp32.trtOther1.8 GB e63e18d15e97
tensorRT/sm_90/sa3-sm-sfx/dit_fp8.trtOther477.6 MB 174f21700dd0
tensorRT/sm_90/same-l/dec_fp16_chunkable_limiter.trtOther1.2 GB 39c0016a68e5
tensorRT/sm_90/same-l/dec_fp8_chunkable_limiter.trtOther951.9 MB d72a0b65ef69
tensorRT/sm_90/same-l/enc_fp16_chunkable.trtOther1.2 GB e3c5f70d5084
tensorRT/sm_90/same-l/enc_fp8_chunkable.trtOther951.5 MB 57eb32ff1134
tensorRT/sm_90/same-l/legacy/dec_dynamic_fp32.trtOther1.7 GB 9f2acd4b7ad4
tensorRT/sm_90/same-l/legacy/dec_dynamic_triton_swa.trtOther1.2 GB 13fdf7dcea5c
tensorRT/sm_90/same-l/legacy/enc_dynamic_triton_swa.trtOther1.2 GB 54bb878c2369
tensorRT/sm_90/same-s/dec_bf16_chunkable_limiter.trtOther117.0 MB c8024409cc7d
tensorRT/sm_90/same-s/dec_fp8_chunkable_limiter.trtOther83.9 MB a5a48d8e6162
tensorRT/sm_90/same-s/enc_bf16_chunkable.trtOther111.5 MB 14a1dc1b2648
tensorRT/sm_90/same-s/enc_fp8_chunkable.trtOther80.4 MB 334ab09cb09c
tensorRT/sm_90/same-s/legacy/dec_dynamic_bf16.trtOther115.1 MB edafd78ff38d
tensorRT/sm_90/same-s/legacy/dec_dynamic_fp32.trtOther219.5 MB cfb0c3319a30
tensorRT/sm_90/same-s/legacy/enc_dynamic_bf16.trtOther112.0 MB ccc98b1eea49
tensorRT/sm_90/t5gemma/t5gemma_fp16.trtOther623.0 MB 1d33c35470e8
tflite/docs/img/dit-ram-rung-vs-varlen-small.pngOther84.4 KB —
tflite/docs/img/dit-ram-rung-vs-varlen.pngOther72.2 KB —
tflite/sa3-m/dit_fp32.tflite.xnnwcOther5.7 GB 7cd74a23f88a
tflite/sa3-m/dit_w8a8.tflite.xnnwcOther1.4 GB 11948de1ab97
.gitattributesRepository2.9 KB —
tensorRT/sm_120/t5gemma/tokenizer.jsonTokenizer34.4 MB 7794135caa3e
tensorRT/sm_90/t5gemma/tokenizer.jsonTokenizer34.4 MB 7794135caa3e
tokenizer.modelTokenizer4.2 MB 61a7b147390c

License and Download

License
other
Access
Open weights, no gate
Download size
84.4 GB
Download from Stability AI

Released by Stability AI through its official repository on Hugging Face.

Built From

  • Described by arXiv:2605.17991

Memory Requirements

PrecisionWeights in memory
As published84.4 GB

Weights only, from the published parameter count; the key-value cache and runtime add to this.

Questions About stable-audio-3-optimized

What license is stable-audio-3-optimized released under?

other, as its publisher declares it. Read the license text before commercial use.

Similar Models

Model · Text to audio

musicgen-medium

AI at Meta

MusicGen is a text-to-music model capable of genreating high-quality music samples conditioned on text descriptions or audio prompts. It is a single stage auto-regressive Transformer model trained over a 32kHz EnCodec tokenizer with 4 codebooks sampled at 50 Hz. Unlike existing methods, like MusicLM, MusicGen doesn't require a self-supervised semantic representation, and it generates all 4 codebooks in one pass. By introducing a small delay between the codebooks, we show we can predict them in parallel, thus having only 50 auto-regressive steps per second of audio. MusicGen was published in Simple and Controllable Music Generation by Jade Copet, Felix Kreuk, Itai Gat, Tal Remez, David Kant…

Open weights cc-by-nc-4.0 transformers

Model · Text to audio

MiniMax-Music3-GGUF

Audio.cpp

GGUF package for MiniMax Music 3 for audio.cpp. Star our repo so you don't miss important updates! https://github.com/0xShug0/audio.cpp Upstream license: https://huggingface.co/MiniMaxAI/MiniMax-Music3/blob/main/LICENSE - The implementation is available on the main branch and release 0.6.1. - The current runtime uses model-local resource loading instead of treating the v1 spec as the runtime contract. This keeps component selection flexible while the package layout and option surface settle. - The default component mix favors Q40 for the large language model and flow transformer, with Q80 for the RVQ depth decoder. - BF16, Q80, and Q40 component variants are included for quality/performance…

Open weights other audio.cpp

Model · Text to audio

Yue2-3B-GGUF

Audio.cpp

This repository contains audio.cpp-native GGUF weights for Yue2-3B. The model has been merged into the main branch. LoRA support added in release 0.8.1. The demos below were generated with yue2-3b-bf16.gguf and yue2-vae-f32.gguf. The q8.wav comparison files were generated with yue2-3b-q80.gguf and yue2-vae-f16.gguf using the same prompts and seeds. The q40.wav comparison files were generated with yue2-3b-q40.gguf and yue2-vae-f16.gguf. Replace with your audio.cpp checkout and with this downloaded GGUF repo directory. To generate the Q40 versions, use the same commands and replace --session-option yue2.modelgguf=yue2-3b-bf16.gguf with --session-option yue2.modelgguf=yue2-3b-q40.gguf, and use…

Open weights cc-by-nc-4.0 audio.cpp

Model · Text to audio

Ruach_Studio_Models

Viktor Zhuromskyy

Every weight Ruach Studio uses, in one repository, laid out exactly as the studio's own folders, so one command puts each file where the studio looks for it: Nothing here is ours. These are the works of the people and teams credited below, re-hosted unchanged (the GGUF files as converted by yue2.cpp's tools, byte for byte the same as their sources'), so that a studio install does not have to visit a dozen repositories. Every file keeps its own licence; most are non-commercial (CC BY-NC 4.0). Using this repository you accept each licence of the files you take. If you are an author and want a file of yours taken down, open a discussion here and it goes. Any LLM quant goes with either…

Open weights other ggml

Four artist-style LoRAs that push YuE2-3B into modern militant roots reggae: dark raspy male patois vocals, steppers and one-drop grooves, deep sub bass, bubbling Hammond, nyabinghi drums, horn stabs, dub sirens and spring reverb. Conscious, apocalyptic, anthemic. Each file patches both halves of YuE2 in one go: the autoregressive planner (writes the score, decides the arrangement and the vocal lines) and the flow-matching decoder (the sound). Trigger word for all three: mltnt. All demos use the same original lyric, seed 7, 32 steps dpm2 / sgmuniform, no post-processing. MLTNT Frontline — baseline recipe, prompt prompts/steppersbaseline.txt, dense lyric (verses written at ~17 words per…

Open weights cc-by-nc-4.0

Experimental calibration-based weight-only GPTQ variant of The Thinker transformer uses 4-bit weights for layers 0–26 and 8-bit weights for layer 27. Audio, vision, talker, token2wav, embeddings, and norms remain in the original precision. Calibration used eight short text samples with LLM Compressor 0.14.0 and compressed-tensors 0.19.0. This checkpoint includes a packaging repair: the compressor export contained invalid group scales, so scales were recomputed from the original BF16 weights per group before the vLLM test. Treat this as an experimental GPTQ-derived checkpoint and benchmark retrieval quality before production use. Tested with vLLM 0.30.0 on an 8-GiB RTX 3080 Laptop GPU: The…

Open weights 2,935 parameters transformers