Skip to page content
SAVRN
Search Plan a project

Open-weight model · Text generation

GLM-5.3-Flash-NVFP4-CSF-QAD

by Local Inference Lab local-inference-lab/GLM-5.3-Flash-NVFP4-CSF-QAD

GLM-5.3-Flash-NVFP4-CSF-QAD is an open-weight model for text generation from Local Inference Lab, released under MIT License. Its published files total 189.0 GB.

A lossless NVFP4-CSF container of local-inference-lab/GLM-5.3-Flash-NVFP4 at revision 175ae8ce3b5af842b0d0140dbeb43e9cfc557c49, the GLM-5.3-Flash QAD checkpoint (NVFP4 routed experts, BF16 dense layers).

Parameters—
Context—
Weights188.9 GB
Licensemit
AccessOpen weights
Monthly Downloads—

Model Card

By Local Inference Lab, published under mit, revision 7714f3ac972e.

A lossless NVFP4-CSF container of local-inference-lab/GLM-5.3-Flash-NVFP4 at revision 175ae8ce3b5af842b0d0140dbeb43e9cfc557c49, the GLM-5.3-Flash QAD checkpoint (NVFP4 routed experts, BF16 dense layers). CSF stores the routed-expert block-scale planes in a compressed form. Nothing else changes: FP4 weight nibbles, every other tensor, the tensor names, dtypes, shapes and the source metadata are all byte-identical. Decoding is integer arithmetic on bytes, with no requantization or fitting. The original safetensors shards can be restored bit-exactly. - Built with trellis-quant trellisquant.losslessscalecheckpoint (commit 60feca330087, family glm53nvfp4). - verification.json: every original…

Read Local Inference Lab's full model card

A lossless NVFP4-CSF container of local-inference-lab/GLM-5.3-Flash-NVFP4 at revision 175ae8ce3b5af842b0d0140dbeb43e9cfc557c49, the GLM-5.3-Flash QAD checkpoint (NVFP4 routed experts, BF16 dense layers).

CSF stores the routed-expert block-scale planes in a compressed form. Nothing else changes: FP4 weight nibbles, every other tensor, the tensor names, dtypes, shapes and the source metadata are all byte-identical. Decoding is integer arithmetic on bytes, with no requantization or fitting. The original safetensors shards can be restored bit-exactly.

Routed experts (layers 3-44 x 288) - NVFP4 (E2M1, E4M3 scale per 16), QAD
MTP (layer 45) routed experts - MXFP8
Attention, shared experts, dense layers - BF16

Routed-expert block scales - lossless NVFP4-CSF (byte-window4-fixed-stream-u24-exceptions/1)

Sizes

  • Weight files: 198.06 GB in the source, 188.87 GB here (9.19 GB saved).
  • Compressed scales: 36,288 matrices (E4M3 block scales of the 42 x 288 x 3 main-layer routed-expert projections): 19.03 GB -> 9.83 GB (51.6%).

Provenance

  • Source: local-inference-lab/GLM-5.3-Flash-NVFP4 revision 175ae8ce3b5af842b0d0140dbeb43e9cfc557c49, 44 index-referenced safetensors shards. During export, each source shard's SHA-256 was checked against its Hugging Face LFS hash.
  • Built with trellis-quant trellis_quant.lossless_scale_checkpoint (commit 60feca330087, family glm53_nvfp4).
  • verification.json: every original shard was rebuilt from this container, and both the rebuilt and the stored files matched their SHA-256 (36,288 scale matrices, 44 shards, passed).
  • Files that the source index does not reference (amax.safetensors, amax_checkpoint.safetensors, model-00036-of-00036.safetensors) are not carried. vLLM never loads them.

Layout

lil-nvfp4-csf-checkpoint/1, codec byte-window4-fixed-stream-u24-exceptions/1:

  • tensors/ - the source shard names; each routed-expert scale <name> is stored as <name>.nvfp4_csf_fixed (uint8) plus <name>.nvfp4_csf_exceptions (uint32)
  • metadata/ - byte copies of the source's config, tokenizer, index, README and LICENSE
  • manifest.json, build-contract.json, receipts/ (per-shard source headers and hashes), verification.json, LICENSE

There is no top-level model.safetensors.index.json, so a plain safetensors loader will not open this directory by mistake.

Serving

Use vLLM with the NVFP4-CSF reader: --quantization nvfp4_csf --load-format nvfp4_csf. Point vLLM at a serving directory that holds the files of metadata/, with config.json's quantization_config replaced by:

{
  "quant_method": "nvfp4_csf",
  "format_version": 1,
  "checkpoint_root": "/path/to/this/checkpoint",
  "source_quantization_config": { "...": "metadata/config.json quantization_config" }
}

The weights are read from checkpoint_root; the serving directory holds only metadata.

Verify or restore

PYTHONPATH=/path/to/trellis-quant python3 -m trellis_quant.lossless_scale_checkpoint verify \
  --checkpoint /path/to/this/checkpoint --workers 16
PYTHONPATH=/path/to/trellis-quant python3 -m trellis_quant.lossless_scale_checkpoint restore \
  --checkpoint /path/to/this/checkpoint --destination /path/to/fresh/dir --workers 16

verify rebuilds every original shard and compares SHA-256 values. restore writes the original shards and metadata files into a fresh directory, checking every hash before a file is published. The result is an ordinary copy of the source checkpoint.

License

Same license as the source; LICENSE is copied unchanged from local-inference-lab/GLM-5.3-Flash-NVFP4.

Identity and Version

Repository
local-inference-lab/GLM-5.3-Flash-NVFP4-CSF-QAD
Publisher
Local Inference Lab
Task
Text generation
Modality
Text
Library
Not stated by the source
Parameters
Not stated by the source
Languages
en, zh
Revision
7714f3ac972e2b33d35651938771744c8d192f3a
First published
2026-10-04
Last updated
2026-10-04

Files and Weights

106 files, 189.0 GB in total. The weights are 44 files totalling 188.9 GB in safetensors.

Weights44 files · 188.9 GB
Configuration54 files · 71.8 MB
Tokenizer2 files · 20.2 MB
Documentation4 files · 10.0 KB
Other1 file · 10.9 KB
Repository1 file · 1.7 KB
Every file
FileTypeSizeSHA-256
tensors/model-00001-of-00036.safetensorsWeights3.4 GB 36ada64dd348
tensors/model-00002-of-00036.safetensorsWeights3.4 GB ddb55d66e117
tensors/model-00003-of-00036.safetensorsWeights3.4 GB 419c16535f4c
tensors/model-00004-of-00036.safetensorsWeights3.4 GB 809387db520d
tensors/model-00005-of-00036.safetensorsWeights3.4 GB d330954c9c74
tensors/model-00006-of-00036.safetensorsWeights3.4 GB dc1a4bf754cf
tensors/model-00007-of-00036.safetensorsWeights3.4 GB 0e20c99581dc
tensors/model-00008-of-00036.safetensorsWeights3.4 GB 7a8ca5143eae
tensors/model-00009-of-00036.safetensorsWeights3.4 GB d816fa38c9b4
tensors/model-00010-of-00036.safetensorsWeights5.1 GB b46285fb9380
tensors/model-00011-of-00036.safetensorsWeights5.1 GB c4c32cbf7351
tensors/model-00012-of-00036.safetensorsWeights5.1 GB 421d34e60054
tensors/model-00013-of-00036.safetensorsWeights5.1 GB 4032ca1c33e6
tensors/model-00014-of-00036.safetensorsWeights5.1 GB e773b2bafd22
tensors/model-00015-of-00036.safetensorsWeights5.1 GB 7a0758fcdcde
tensors/model-00016-of-00036.safetensorsWeights5.1 GB 3e3ea904cd4b
tensors/model-00017-of-00036.safetensorsWeights5.1 GB a802e7819ed6
tensors/model-00018-of-00036.safetensorsWeights5.1 GB 76a33fdba6bf
tensors/model-00019-of-00036.safetensorsWeights5.1 GB 4e3395bd41ff
tensors/model-00020-of-00036.safetensorsWeights5.1 GB daad6c90a586
tensors/model-00021-of-00036.safetensorsWeights5.1 GB 9b7904956205
tensors/model-00022-of-00036.safetensorsWeights5.1 GB 27dfad784483
tensors/model-00023-of-00036.safetensorsWeights5.1 GB 0f8b22fb02f0
tensors/model-00024-of-00036.safetensorsWeights5.1 GB d2e74c4ad3c6
tensors/model-00025-of-00036.safetensorsWeights5.1 GB 37cb1fa485ac
tensors/model-00026-of-00036.safetensorsWeights5.1 GB dc94dab6364e
tensors/model-00027-of-00036.safetensorsWeights5.1 GB 0a3dc8cab7f0
tensors/model-00028-of-00036.safetensorsWeights5.1 GB f5c6238ce247
tensors/model-00029-of-00036.safetensorsWeights5.1 GB 280d9bac0e56
tensors/model-00030-of-00036.safetensorsWeights5.1 GB d52135a97877
tensors/model-00031-of-00036.safetensorsWeights5.1 GB 8ea9e8614ae9
tensors/model-00032-of-00036.safetensorsWeights5.1 GB 2c06a95c5afd
tensors/model-00033-of-00036.safetensorsWeights5.1 GB b24627281d1f
tensors/model-00034-of-00036.safetensorsWeights5.1 GB 07b831c823cc
tensors/model-00035-of-00036.safetensorsWeights5.1 GB e63c79bc9919
tensors/model-hf-nonexpert-00001-of-00004.safetensorsWeights5.4 GB cfec50cd5f1e
tensors/model-hf-nonexpert-00002-of-00004.safetensorsWeights5.3 GB 7abeb82fc798
tensors/model-hf-nonexpert-00003-of-00004.safetensorsWeights5.3 GB 7923cd60fec2
tensors/model-hf-nonexpert-00004-of-00004.safetensorsWeights3.0 GB 2352640aa9a0
tensors/model-inputscales.safetensorsWeights4.7 MB 20cac73c3938
tensors/model-mtp-00001-of-00004.safetensorsWeights67.1 MB 3fed3b7c82a2
tensors/model-mtp-00002-of-00004.safetensorsWeights2.8 GB a1f3aad5ae25
tensors/model-mtp-00003-of-00004.safetensorsWeights2.8 GB e11ed98dcaed
tensors/model-mtp-00004-of-00004.safetensorsWeights2.2 GB 088513ba67f8
build-contract.jsonConfiguration16.3 MB 47d5fb81d184
manifest.jsonConfiguration16.3 KB —
metadata/amax_checkpoint.jsonConfiguration1.1 KB —
metadata/config.jsonConfiguration15.8 KB —
metadata/generation_config.jsonConfiguration194 B —
metadata/hf_quant_config.jsonConfiguration8.1 KB —
metadata/model.safetensors.index.jsonConfiguration16.3 MB b43d25a280d0
metadata/processor_config.jsonConfiguration909 B —
metadata/quatrain-materialization.jsonConfiguration44.3 KB —
receipts/model-00001-of-00036.safetensors.jsonConfiguration667.9 KB —
receipts/model-00002-of-00036.safetensors.jsonConfiguration669.7 KB —
receipts/model-00003-of-00036.safetensors.jsonConfiguration669.7 KB —
receipts/model-00004-of-00036.safetensors.jsonConfiguration670.0 KB —
receipts/model-00005-of-00036.safetensors.jsonConfiguration671.9 KB —
receipts/model-00006-of-00036.safetensors.jsonConfiguration671.9 KB —
receipts/model-00007-of-00036.safetensors.jsonConfiguration670.0 KB —
receipts/model-00008-of-00036.safetensors.jsonConfiguration671.9 KB —
receipts/model-00009-of-00036.safetensors.jsonConfiguration671.9 KB —
receipts/model-00010-of-00036.safetensors.jsonConfiguration1.0 MB —
receipts/model-00011-of-00036.safetensors.jsonConfiguration1.0 MB —
receipts/model-00012-of-00036.safetensors.jsonConfiguration1.0 MB —
receipts/model-00013-of-00036.safetensors.jsonConfiguration1.0 MB —
receipts/model-00014-of-00036.safetensors.jsonConfiguration1.0 MB —
receipts/model-00015-of-00036.safetensors.jsonConfiguration1.0 MB —
receipts/model-00016-of-00036.safetensors.jsonConfiguration1.0 MB —
receipts/model-00017-of-00036.safetensors.jsonConfiguration1.0 MB —
receipts/model-00018-of-00036.safetensors.jsonConfiguration1.0 MB —
receipts/model-00019-of-00036.safetensors.jsonConfiguration1.0 MB —
receipts/model-00020-of-00036.safetensors.jsonConfiguration1.0 MB —
receipts/model-00021-of-00036.safetensors.jsonConfiguration1.0 MB —
receipts/model-00022-of-00036.safetensors.jsonConfiguration1.0 MB —
receipts/model-00023-of-00036.safetensors.jsonConfiguration1.0 MB —
receipts/model-00024-of-00036.safetensors.jsonConfiguration1.0 MB —
receipts/model-00025-of-00036.safetensors.jsonConfiguration1.0 MB —
receipts/model-00026-of-00036.safetensors.jsonConfiguration1.0 MB —
receipts/model-00027-of-00036.safetensors.jsonConfiguration1.0 MB —
receipts/model-00028-of-00036.safetensors.jsonConfiguration1.0 MB —
receipts/model-00029-of-00036.safetensors.jsonConfiguration1.0 MB —
receipts/model-00030-of-00036.safetensors.jsonConfiguration1.0 MB —
receipts/model-00031-of-00036.safetensors.jsonConfiguration1.0 MB —
receipts/model-00032-of-00036.safetensors.jsonConfiguration1.0 MB —
receipts/model-00033-of-00036.safetensors.jsonConfiguration1.0 MB —
receipts/model-00034-of-00036.safetensors.jsonConfiguration1.0 MB —
receipts/model-00035-of-00036.safetensors.jsonConfiguration1.0 MB —
receipts/model-hf-nonexpert-00001-of-00004.safetensors.jsonConfiguration34.8 KB —
receipts/model-hf-nonexpert-00002-of-00004.safetensors.jsonConfiguration73.6 KB —
receipts/model-hf-nonexpert-00003-of-00004.safetensors.jsonConfiguration79.9 KB —
receipts/model-hf-nonexpert-00004-of-00004.safetensors.jsonConfiguration77.6 KB —
receipts/model-inputscales.safetensors.jsonConfiguration6.1 MB —
receipts/model-mtp-00001-of-00004.safetensors.jsonConfiguration1.0 KB —
receipts/model-mtp-00002-of-00004.safetensors.jsonConfiguration123.0 KB —
receipts/model-mtp-00003-of-00004.safetensors.jsonConfiguration122.9 KB —
receipts/model-mtp-00004-of-00004.safetensors.jsonConfiguration89.4 KB —
verification.jsonConfiguration13.8 KB —
LICENSEDocumentation1.1 KB —
README.mdDocumentation4.0 KB —
metadata/LICENSEDocumentation1.1 KB —
metadata/README.mdDocumentation3.8 KB —
metadata/chat_template.jinjaOther10.9 KB —
.gitattributesRepository1.7 KB —
metadata/tokenizer.jsonTokenizer20.2 MB 19e773648cb4
metadata/tokenizer_config.jsonTokenizer761 B —

License and Download

License
mit
Access
Open weights, no gate
Download size
188.9 GB
Download from Local Inference Lab

Released by Local Inference Lab through its official repository on Hugging Face. Read the license.

Built From

  • Derived from local-inference-lab/GLM-5.3-Flash-NVFP4
  • Quantized from local-inference-lab/GLM-5.3-Flash-NVFP4

Memory Requirements

PrecisionWeights in memory
As published188.9 GB

Weights only, from the published parameter count; the key-value cache and runtime add to this.

Questions About GLM-5.3-Flash-NVFP4-CSF-QAD

Can I use GLM-5.3-Flash-NVFP4-CSF-QAD commercially?

Yes. GLM-5.3-Flash-NVFP4-CSF-QAD is released under MIT License. The MIT License is a short permissive license. It permits commercial use, modification and redistribution, provided the copyright notice and permission notice are included.

Similar Models

Model · Text generation

opt-125m

AI at Meta

OPT was first introduced in Open Pre-trained Transformer Language Models and first released in metaseq's repository on May 3rd 2022 by Meta AI. Disclaimer: The team releasing OPT wrote an official model card, which is available in Appendix D of the paper. Content from this model card has been written by the Hugging Face team. To quote the first two paragraphs of the official paper OPT was predominantly pretrained with English text, but a small amount of non-English data is still present within the training corpus via CommonCrawl. The model was pretrained using a causal language modeling (CLM) objective. OPT belongs to the same family of decoder-only models like GPT-3. As such, it was…

Open weights other 2,048 tokens transformers

Model · Text generation

Ornith-1.5-9B-GGUF

Ornith

Chirp Chirp! We are introducing Ornith-1.5, a major step toward building foundation models through end-to-end self-improvement. Ornith-1.5 extends Ornith-1.0 (which was developed on top of Qwen3.5 and Gemma4 with additional continued pretraining, mid-training, and post-training) by expanding the self-improvement loop from scaffold and rollout optimization to jointly optimizing task generation, scaffold construction, and solution rollouts. Rather than relying on a fixed set of human-curated tasks and manually designed harnesses, Ornith-1.5 continuously generates new training tasks, discovers effective strategies for solving them, and improves the policy through reinforcement learning. For…

Open weights mit transformers

Model · Text generation

Ornith-1.5-35B-A3B-GGUF

Ornith

Chirp Chirp! We are introducing Ornith-1.5, a major step toward building foundation models through end-to-end self-improvement. Ornith-1.5 extends Ornith-1.0 (which was developed on top of Qwen3.5 and Gemma4 with additional continued pretraining, mid-training, and post-training) by expanding the self-improvement loop from scaffold and rollout optimization to jointly optimizing task generation, scaffold construction, and solution rollouts. Rather than relying on a fixed set of human-curated tasks and manually designed harnesses, Ornith-1.5 continuously generates new training tasks, discovers effective strategies for solving them, and improves the policy through reinforcement learning. For…

Open weights mit transformers

Model · Text generation

Ternary-Bonsai-2-27B-gguf

Prism ML

Full 27B-class reasoning in ternary transformer weights, for llama.cpp (CUDA, Metal, CPU) - \~5.9 GB language model (down from \~54 GB FP16) — full 27B-class reasoning on a standard laptop or a single GPU - 98.2% of FP16 intelligence retained: 84.78 average across 14 thinking-mode benchmarks — far above the conventional IQ2XXS build (72.59) at about 82% of its footprint, and within 0.4 points of UD-Q4KXL at three times the footprint - Retains thinking, reasoning, and agentic behavior deep in the sub-4-bit regime, where conventional low-bit representations collapse: math within half a point of full precision (96.57), coding level with the baseline (89.42), agentic tool calling at 74.92…

Open weights apache-2.0 llama.cpp

Uncensored Qwen3.8-27B, published as GGUF quantizations with the multi token prediction (MTP) head retained and verified. Refusal behaviour has been substantially reduced, not eliminated. See Measured behaviour for the numbers. Capabilities, training data, and architecture are otherwise unchanged. - Refusal directions removed with Heretic, which co minimizes refusal count against KL divergence from the base model. No handwritten refusal removal code, no finetuning, no additional training data. - Abliteration runs at bf16 (no 4 bit quantization). the resulting LoRA is merged into the bf16 base, so the published weights are not a quantized round trip. - mtp. tensors are copied verbatim from…

Open weights apache-2.0 llama.cpp

Model · Text generation

Ornith-1.0-9B-GGUF

Ornith

Aloha! Today, we are releasing Ornith-1.0, a self-improving family of open-source models for agentic coding. This model card documents Ornith-1.0-9B, the most lightweight member of the Ornith family, designed for efficient single-GPU deployment. Ornith-1.0-9B is a dense ~9B model (≈19 GB in bf16), so it serves comfortably on a single 80GB GPU. The recipes below stand up an OpenAI-compatible server; add --tensor-parallel-size / --tp if you want to shard across more GPUs. For a quick local test (or to script offline generation), load the model directly with Transformers. Make sure you have a recent release installed — see the Transformers installation guide; Ornith-1.0-9B requires…

Open weights mit transformers