Skip to page content
SAVRN
Search Plan a project

Open-weight model · Text generation

Nemotron-Labs-Diffusion-3B-PIG

by IFML UT-IFML/Nemotron-Labs-Diffusion-3B-PIG

Nemotron-Labs-Diffusion-3B-PIG is an open-weight model for text generation from IFML, released under other. It has 3.8B parameters. At 16-bit it needs about 9.2 GB of GPU memory, which fits on 1x MI300X from $1.85 an hour, at the lowest prices in the SAVRN Index. It draws 82 downloads a month.

Nemotron-Labs-Diffusion-3B, NVIDIA's instruct model, with Parallel Inconsistency Guidance (PIG), which lets the model commit more tokens per forward pass at the same accuracy.

Parameters3.8B
Context—
Weights7.7 GB
Licenseother
AccessOpen weights
Monthly Downloads82

Runs On

What it takes to serve Nemotron-Labs-Diffusion-3B-PIG (3.8B parameters): the memory its weights need at each precision, and the cheapest way to rent enough data-center GPUs to hold them.

PrecisionWeightsMemory neededCheapest setupPer hourAlso fits
16-bit 7.7 GB 9.2 GB 1x MI300X (192 GB)
Vultr
$1.85 1x H100 $1.99 · 1x MI325X $2.00
8-bit 3.8 GB 4.6 GB 1x MI300X (192 GB)
Vultr
$1.85 1x H100 $1.99 · 1x MI325X $2.00
4-bit 1.9 GB 2.3 GB 1x MI300X (192 GB)
Vultr
$1.85 1x H100 $1.99 · 1x MI325X $2.00

Memory is the weights at that precision plus 20% for the runtime and a short context; a long context needs more. Prices are the lowest on-demand hourly rates in the SAVRN Index, read Oct 18, 2026.

Nemotron-Labs-Diffusion-3B-PIG on every accelerator the SAVRN Index prices, at every precision

Model Card

Nemotron-Labs-Diffusion-3B, NVIDIA's instruct model, with Parallel Inconsistency Guidance (PIG), which lets the model commit more tokens per forward pass at the same accuracy. This repository is the whole model: the backbone, a 1.9M-parameter PIG adapter and its calibration tables. Paper: PIG: Parallel Inconsistency Guidance for Accelerating Diffusion Language Models, Fruytier, Xue, Shakkottai, Sanghavi (UT Austin), 2026; arXiv:2610.17375. Code: https://github.com/Quentin-Fruytier/PIG-DLM-release Blog: Which tokens can a diffusion language model commit together? Needs transformers 5.x and a GPU with 8 GB. Implementation details, every argument, and how the adapter and tables were fitted…

Excerpt from the card by IFML, licensed other.

Configuration

Architecture
PIGModel
Model type
pig

Identity and Version

Repository
UT-IFML/Nemotron-Labs-Diffusion-3B-PIG
Publisher
IFML
Task
Text generation
Modality
Text
Library
transformers
Parameters
3.8B parameters
Languages
en
Revision
4f7128652c7127582e6f6da072f415484c95c93d
First published
2026-10-12
Last updated
2026-10-17

Files and Weights

18 files, 7.7 GB in total. The weights are 2 files totalling 7.7 GB in safetensors.

Weights2 files · 7.7 GB
Configuration8 files · 139.7 KB
Tokenizer2 files · 17.3 MB
Documentation4 files · 23.7 KB
Other1 file · 10.5 KB
Repository1 file · 1.6 KB
Every file
FileTypeSizeSHA-256
model-00001-of-00002.safetensorsWeights7.7 GB 2f4276c24a33
model-00002-of-00002.safetensorsWeights7.6 MB d1398dfdb452
config.jsonConfiguration2.7 KB —
configuration_nemotron_labs_diffusion.pyConfiguration8.6 KB —
configuration_pig.pyConfiguration1.9 KB —
model.safetensors.index.jsonConfiguration25.6 KB —
modeling_ministral.pyConfiguration20.8 KB —
modeling_nemotron_labs_diffusion.pyConfiguration36.6 KB —
modeling_pig.pyConfiguration43.1 KB —
special_tokens_map.jsonConfiguration420 B —
AGENTS.mdDocumentation11.7 KB —
LICENSEDocumentation8.0 KB —
NOTICE.mdDocumentation858 B —
README.mdDocumentation3.1 KB —
chat_template.jinjaOther10.5 KB —
.gitattributesRepository1.6 KB —
tokenizer.jsonTokenizer17.1 MB 623c34567aeb
tokenizer_config.jsonTokenizer177.2 KB —

License and Download

License
other
Access
Open weights, no gate
Download size
7.7 GB
Download from IFML

Released by IFML through its official repository on Hugging Face.

Built From

  • Adapter of nvidia/Nemotron-Labs-Diffusion-3B
  • Derived from nvidia/Nemotron-Labs-Diffusion-3B
  • Described by arXiv:2610.17375

Memory Requirements

PrecisionWeights in memory
As published7.7 GB
16-bit7.7 GB
8-bit3.8 GB
4-bit1.9 GB

Weights only, from the published parameter count; the key-value cache and runtime add to this.

Questions About Nemotron-Labs-Diffusion-3B-PIG

How much GPU memory does Nemotron-Labs-Diffusion-3B-PIG need?

About 9.2 GB at 16-bit and 2.3 GB at 4-bit: the weights (3.8B parameters) plus a working margin. A long context needs more.

What is the cheapest GPU to run Nemotron-Labs-Diffusion-3B-PIG on?

At 16-bit, 1x MI300X from $1.85 an hour; at 4-bit, 1x MI300X from $1.85 an hour, at the lowest on-demand prices the SAVRN Index lists.

What license is Nemotron-Labs-Diffusion-3B-PIG released under?

other, as its publisher declares it. Read the license text before commercial use.

Similar Models

Model · Text generation

phi4-clinical-mlx

Web

A specialized 3.8B biomedical & clinical reasoning model built on Microsoft's Phi-4-mini-instruct, optimized natively for Apple Silicon Metal acceleration via Apple MLX. The model underwent a 3-stage transfer learning curriculum: 1. Stage 1 (STEM Foundation): 116,000 instruction pairs across NCERT Classes 6–12 (Physics, Chemistry, Biology) eliminating foundational science hallucinations. 2. Stage 2 (PubMed 2026 Evidence): 12 recent 2026 clinical update archives from NCBI FTP covering survival outcomes (OS, PFS, HR), targeted therapeutics, and clinical trial endpoints. 3. Stage 3 (Comprehensive Internal Medicine): Balanced multi-specialty clinical curriculum (cardiology, nephrology…

Open weights mit 3.8B parameters 131,072 tokens mlx

Model · Text generation

phi4-clinical

Web

A specialized 3.8B biomedical & clinical reasoning foundation model built on Microsoft's Phi-4-mini-instruct, formatted for standard Hugging Face transformers and PyTorch. 1. Stage 1 (STEM Foundation): 116,000 instruction pairs across NCERT Classes 6–12 (Physics, Chemistry, Biology) eliminating foundational science hallucinations. 2. Stage 2 (PubMed 2026 Evidence): 12 recent 2026 clinical update archives from NCBI FTP covering survival outcomes (OS, PFS, HR), targeted therapeutics, and clinical trial endpoints. 3. Stage 3 (Comprehensive Internal Medicine): Balanced multi-specialty clinical curriculum (cardiology, nephrology, endocrinology, pulmonology) with an active oncology replay buffer.…

Open weights mit 3.8B parameters 131,072 tokens transformers

Model · Text generation

StandardOne-3B

Standard Thinking

Standard One scores a bounded set of answers for a supplied scenario and returns probabilities through POST /v1/systemone. It does not generate free-form response text. This repository contains the merged BF16 3B checkpoint; the server code is in StandardOne-8B. In the reported served evaluations, 3B has a lower median latency on the measured short-request profile; 8B scores higher on the public standard and hard tiers. See Benchmarks for the measurement conditions and limitations. The figure combines results from different measurement paths. See Benchmarks for served versus offline conditions; measured 24–26 September 2026. - Send a state and a bounded rubric to receive probabilities for…

Open weights apache-2.0 3.8B parameters 262,144 tokens transformers

Model · Text generation

StandardOne-3B-FP8

Standard Thinking

StandardOne-3B-FP8 is an FP8 (compressed-tensors, float8e4m3 weights, dynamic per-token activations) quantization of the released StandardOne-3B decision model. The language-model linear projections (q/k/v/o, gate/up/down) are quantized per-channel FP8 E4M3 with dynamic FP8 activations (llm-compressor's data-free FP8DYNAMIC recipe, no calibration data required); the vision tower, multi-modal projector, embeddings and lmhead are left unquantized in BF16. It was produced from source revision 68dafd17ead9b8cf6f85c4f08f7f2f3a1e7b9e5c of StandardOne-3B on 2026-09-25 using llm-compressor 0.14.0 (torch 2.14.0, transformers 5.17.0, compressed-tensors 0.19.0); results below. Served through SGLang…

Open weights apache-2.0 3.8B parameters 262,144 tokens transformers

Model · Text generation

NULLXES-SHINRA-4B-SMOKE

Maga

NULLXES SHINRA-4B-INSTRUCT is the Language Intelligence Layer of the NULLXES system. SHINRA is responsible for multilingual understanding, coding intelligence, instruction following, structured outputs, and agent preparation. This checkpoint is the instruction-tuned (and optionally DPO-aligned) 4B-class dense decoder. Proprietary ShinraForCausalLM (not a Llama / Mistral / Qwen / GPT-NeoX wrapper). RMSNorm → GQA+RoPE → residual → RMSNorm → SwiGLU → residual then final RMSNorm and tied LM head. Special tokens:. Generation stop is. Document stop is. Three stages. Pretrain → NULLXES SHINRA-4B-BASE SHINRAPRETRAINV1: 40% FineWeb-Edu, 20% code (python-edu + licensed Stack), 15% math/science…

Open weights other 3.9B parameters 32,768 tokens transformers

Model · Text generation

NULLXES-SHINRA-4B-INSTRUCT

Maga

Language Intelligence layer of the NULLXES Intelligence Stack. SHINRA Our llm. Release line 1. NULLXES SHINRA-4B-BASE — pretrain 2. NULLXES SHINRA-4B-INSTRUCT — instruction tuning ← this model 3. NULLXES SHINRA-4B-INSTRUCT (aligned) — DPO / preference optimization Parameter budget Architecture source: configs/shinra4b.yaml at 903a639e03bc. The total also matches the published safetensors metadata. Custom SentencePiece Unigram, trained in-house on a web + wiki + code mix. Special tokens trustremotecode=True is required: SHINRA ships a custom ShinraConfig and modeling code, not a reused architecture class. The HF inference widget cannot load custom code, hence inference: false. Data pipeline…

Open weights other 3.9B parameters 32,768 tokens transformers