SAVRN
Search Contact SAVRN

Open-weight model · Text generation

iclr-debug

by Ishan Khare iskhare/iclr-debug

Public artifacts for the iclr-debug branch of HazyResearch/MsTok. This repository currently establishes the experiment namespace and contains a training-budget audit. No new model weights or final benchmark claims are implied.

Parameters
Context
Weights80.8 GB
License
AccessOpen weights
Monthly Downloads

Model Card

Public artifacts for the iclr-debug branch of HazyResearch/MsTok. This repository currently establishes the experiment namespace and contains a training-budget audit. No new model weights or final benchmark claims are implied. Future selected checkpoints and evaluations will be organized by unique run ID and optimizer step. Training budgets must report raw token positions per component, dataset size, global batch, optimizer updates, and LR horizons. Generation reports must label supplied-level-zero versus unconditional sampling and record the reference model precision, entropy, scored-token counts, and per-seed results. See NCM-BUDGET-AUDIT.md for historical budget provenance and…

Excerpt from the card by Ishan Khare.

Identity and Version

Repository
iskhare/iclr-debug
Publisher
Ishan Khare
Task
Text generation
Modality
Text
Library
Not stated by the source
Parameters
Not stated by the source
Languages
en
Revision
cd965c34bd8a6b8fe0e307611b2ccb51f5cee374
First published
2026-09-16
Last updated
2026-09-18

Files and Weights

256 files, 80.8 GB in total. The weights are 53 files totalling 80.8 GB in pt.

Weights53 files · 80.8 GB
Configuration183 files · 13.4 MB
Documentation10 files · 20.6 KB
Other9 files · 2.9 MB
Repository1 file · 1.5 KB
Every file
FileTypeSizeSHA-256
iclr-debug-decoder-135b-20260916/decoder-mstok/milestone-iter-28000.ptWeights4.9 GB d9eb43b22050
iclr-debug-generator-decay27b-20260917/generator/exports/step-4769/ncp.ptWeights427.5 MB 4a206de96016
iclr-debug-generator-decay27b-20260917/generator/exports/step-4769/vqvae.ptWeights1.3 GB 02db929f1a93
iclr-debug-generator-decay27b-20260917/generator/exports/step-954/ncp.ptWeights427.5 MB 26e838595b2a
iclr-debug-generator-decay27b-20260917/generator/exports/step-954/vqvae.ptWeights1.3 GB 82330b032665
iclr-debug-generator-decay27b-20260917/generator/milestone-iter-4769.ptWeights2.6 GB 6bb147d252cf
iclr-debug-generator-decay27b-20260917/generator/milestone-iter-954.ptWeights2.6 GB c10ba05414c0
iclr-debug-tokenizer13k-generator135b-decay20-v1/generator/exports/step-4769/ncp.ptWeights427.5 MB 90fc12236503
iclr-debug-tokenizer13k-generator135b-decay20-v1/generator/exports/step-4769/vqvae.ptWeights1.3 GB 94b189af18f4
iclr-debug-tokenizer13k-generator135b-decay20-v1/generator/exports/step-6000/ncp.ptWeights427.5 MB bc48b37f0587
iclr-debug-tokenizer13k-generator135b-decay20-v1/generator/exports/step-6000/vqvae.ptWeights1.3 GB 8fce8e7eec28
iclr-debug-tokenizer13k-generator135b-decay20-v1/generator/exports/step-954/ncp.ptWeights427.5 MB 9f5c21796756
iclr-debug-tokenizer13k-generator135b-decay20-v1/generator/exports/step-954/vqvae.ptWeights1.3 GB 1ece09cc869a
iclr-debug-tokenizer13k-generator135b-decay20-v1/generator/milestone-iter-4769.ptWeights2.6 GB c9c0b56a8b2f
iclr-debug-tokenizer13k-generator135b-decay20-v1/generator/milestone-iter-6000.ptWeights2.6 GB 3a454ae5af8f
iclr-debug-tokenizer13k-generator135b-decay20-v1/generator/milestone-iter-954.ptWeights2.6 GB bb64f656e014
iclr-debug-tokenizer13k-generator135b-v1/generator/exports/step-12875/ncp.ptWeights427.5 MB 650258c61f64
iclr-debug-tokenizer13k-generator135b-v1/generator/exports/step-12875/vqvae.ptWeights1.3 GB 4cc7e8166017
iclr-debug-tokenizer13k-generator135b-v1/generator/exports/step-25750/ncp.ptWeights427.5 MB d9ae1a400c02
iclr-debug-tokenizer13k-generator135b-v1/generator/exports/step-25750/vqvae.ptWeights1.3 GB 5c4d18b144a6
iclr-debug-tokenizer13k-generator135b-v1/generator/exports/step-36000/ncp.ptWeights427.5 MB 7d0b65d49302
iclr-debug-tokenizer13k-generator135b-v1/generator/exports/step-36000/vqvae.ptWeights1.3 GB df8304968d70
iclr-debug-tokenizer13k-generator135b-v1/generator/exports/step-37000/ncp.ptWeights427.5 MB 8c2fdd6cc055
iclr-debug-tokenizer13k-generator135b-v1/generator/exports/step-37000/vqvae.ptWeights1.3 GB 3671c7ba0940
iclr-debug-tokenizer13k-generator135b-v1/generator/exports/step-4769/ncp.ptWeights427.5 MB 974ec9ff38f5
iclr-debug-tokenizer13k-generator135b-v1/generator/exports/step-4769/vqvae.ptWeights1.3 GB 1ac343380be9
iclr-debug-tokenizer13k-generator135b-v1/generator/exports/step-6000/ncp.ptWeights427.5 MB 4144b5d16988
iclr-debug-tokenizer13k-generator135b-v1/generator/exports/step-6000/vqvae.ptWeights1.3 GB 0dc7ddfcf20c
iclr-debug-tokenizer13k-generator135b-v1/generator/exports/step-954/ncp.ptWeights427.5 MB 38d7177ef663
iclr-debug-tokenizer13k-generator135b-v1/generator/exports/step-954/vqvae.ptWeights1.3 GB e0416b02fc33
iclr-debug-tokenizer13k-generator135b-v1/generator/milestone-iter-12875.ptWeights2.6 GB 3f4355775898
iclr-debug-tokenizer13k-generator135b-v1/generator/milestone-iter-25750.ptWeights2.6 GB f6bafeffd555
iclr-debug-tokenizer13k-generator135b-v1/generator/milestone-iter-4769.ptWeights2.6 GB 5417bac92168
iclr-debug-tokenizer13k-generator135b-v1/generator/milestone-iter-6000.ptWeights2.6 GB a52394f4cffc
iclr-debug-tokenizer13k-generator135b-v1/generator/milestone-iter-954.ptWeights2.6 GB 1aac95b264e4
iclr-debug-tokenizer13k-generator135b-v1/generator/retained-best-val-iter-36000.ptWeights2.6 GB 996781be0095
iclr-debug-tokenizer13k-generator135b-v1/generator/retained-stop-iter-37000.ptWeights2.6 GB 772a61e696d2
iclr-debug-two-stage-135b-20260916/generator/checkpoint-iter-22000.ptWeights2.6 GB 82f0fecddd66
iclr-debug-two-stage-135b-20260916/generator/checkpoint-iter-44000.ptWeights2.6 GB dd84df67dc53
iclr-debug-two-stage-135b-20260916/generator/checkpoint-iter-45000.ptWeights2.6 GB 729d7432a0d9
iclr-debug-two-stage-135b-20260916/generator/exports/step-12875/ncp.ptWeights427.5 MB b0873bffc388
iclr-debug-two-stage-135b-20260916/generator/exports/step-12875/vqvae.ptWeights1.3 GB 482c95118ff9
iclr-debug-two-stage-135b-20260916/generator/exports/step-22000/ncp.ptWeights427.5 MB 14f9b9044729
iclr-debug-two-stage-135b-20260916/generator/exports/step-22000/vqvae.ptWeights1.3 GB 038ab43f0606
iclr-debug-two-stage-135b-20260916/generator/exports/step-44000/ncp.ptWeights427.5 MB 59e5405c493f
iclr-debug-two-stage-135b-20260916/generator/exports/step-44000/vqvae.ptWeights1.3 GB f85bbb9c5187
iclr-debug-two-stage-135b-20260916/generator/exports/step-45000/ncp.ptWeights427.5 MB ed0cf1f72bed
iclr-debug-two-stage-135b-20260916/generator/exports/step-45000/vqvae.ptWeights1.3 GB a16ecf6a1b8f
iclr-debug-two-stage-135b-20260916/generator/milestone-iter-12875.ptWeights2.6 GB fefa9b7bf940
iclr-debug-two-stage-135b-20260916/tokenizer/checkpoint-iter-128747.ptWeights2.3 GB 0078f567fdf3
iclr-debug-two-stage-135b-20260916/tokenizer/checkpoint-iter-13000.ptWeights2.3 GB 9dba57e01498
iclr-debug-two-stage-135b-20260916/tokenizer/exports/step-128747/vqvae.ptWeights1.3 GB 48f37a4e708a
iclr-debug-two-stage-135b-20260916/tokenizer/exports/step-13000/vqvae.ptWeights1.3 GB 881095e365c8
iclr-debug-decoder-135b-20260916/decoder-mstok/config.yamlConfiguration4.8 KB
iclr-debug-decoder-135b-20260916/decoder-mstok/evaluation/step-28000-fp64/controller.pyConfiguration3.1 KB
iclr-debug-decoder-135b-20260916/decoder-mstok/evaluation/step-28000-fp64/evaluator.pyConfiguration7.7 KB
iclr-debug-decoder-135b-20260916/decoder-mstok/evaluation/step-28000-fp64/manifest.jsonConfiguration916 B
iclr-debug-decoder-135b-20260916/decoder-mstok/evaluation/step-28000-fp64/quality-summary.jsonConfiguration2.9 KB
iclr-debug-decoder-135b-20260916/decoder-mstok/evaluation/step-28000-fp64/random-seed-0.jsonConfiguration139.3 KB
iclr-debug-decoder-135b-20260916/decoder-mstok/evaluation/step-28000-fp64/random-seed-0.samples.jsonConfiguration129.4 KB
iclr-debug-decoder-135b-20260916/decoder-mstok/evaluation/step-28000-fp64/random-seed-1.jsonConfiguration141.6 KB
iclr-debug-decoder-135b-20260916/decoder-mstok/evaluation/step-28000-fp64/random-seed-1.samples.jsonConfiguration131.6 KB
iclr-debug-decoder-135b-20260916/decoder-mstok/evaluation/step-28000-fp64/random-seed-2.jsonConfiguration143.2 KB
iclr-debug-decoder-135b-20260916/decoder-mstok/evaluation/step-28000-fp64/random-seed-2.samples.jsonConfiguration133.3 KB
iclr-debug-decoder-135b-20260916/decoder-mstok/evaluation/step-28000-fp64/random-seed-3.jsonConfiguration141.3 KB
iclr-debug-decoder-135b-20260916/decoder-mstok/evaluation/step-28000-fp64/random-seed-3.samples.jsonConfiguration131.4 KB
iclr-debug-decoder-135b-20260916/decoder-mstok/evaluation/step-28000-fp64/random-seed-4.jsonConfiguration140.8 KB
iclr-debug-decoder-135b-20260916/decoder-mstok/evaluation/step-28000-fp64/random-seed-4.samples.jsonConfiguration130.9 KB
iclr-debug-decoder-135b-20260916/decoder-mstok/evaluation/step-28000-fp64/summarize-quality.pyConfiguration3.8 KB
iclr-debug-decoder-135b-20260916/decoder-mstok/evaluation/step-28000-fp64/summary.jsonConfiguration1.2 KB
iclr-debug-decoder-135b-20260916/decoder-mstok/teacher-provenance.jsonConfiguration270 B
iclr-debug-decoder-135b-20260916/git-provenance.jsonConfiguration59 B
iclr-debug-decoder-135b-20260916/manifest.jsonConfiguration29.0 KB
iclr-debug-decoder-135b-20260916/provenance/hf-backup-step-28000-manifest.jsonConfiguration5.1 KB
iclr-debug-generator-decay27b-20260917/generator/config.yamlConfiguration4.6 KB
iclr-debug-generator-decay27b-20260917/git-provenance.jsonConfiguration59 B
iclr-debug-generator-decay27b-20260917/manifest.jsonConfiguration28.9 KB
iclr-debug-generator-decay27b-20260917/tests/test_evaluation_precision.pyConfiguration2.1 KB
iclr-debug-tokenizer13k-generator135b-decay20-v1/generator/config.yamlConfiguration4.7 KB
iclr-debug-tokenizer13k-generator135b-decay20-v1/generator/evaluation/step-6000/EVAL_DONE.jsonConfiguration96 B
iclr-debug-tokenizer13k-generator135b-decay20-v1/generator/evaluation/step-6000/random-seed-0.jsonConfiguration130.4 KB
iclr-debug-tokenizer13k-generator135b-decay20-v1/generator/evaluation/step-6000/random-seed-0.samples.jsonConfiguration130.8 KB
iclr-debug-tokenizer13k-generator135b-decay20-v1/generator/evaluation/step-6000/random-seed-1.jsonConfiguration132.8 KB
iclr-debug-tokenizer13k-generator135b-decay20-v1/generator/evaluation/step-6000/random-seed-1.samples.jsonConfiguration133.2 KB
iclr-debug-tokenizer13k-generator135b-decay20-v1/generator/evaluation/step-6000/random-seed-2.jsonConfiguration134.6 KB
iclr-debug-tokenizer13k-generator135b-decay20-v1/generator/evaluation/step-6000/random-seed-2.samples.jsonConfiguration135.0 KB
iclr-debug-tokenizer13k-generator135b-decay20-v1/generator/evaluation/step-6000/random-seed-3.jsonConfiguration131.2 KB
iclr-debug-tokenizer13k-generator135b-decay20-v1/generator/evaluation/step-6000/random-seed-3.samples.jsonConfiguration131.5 KB
iclr-debug-tokenizer13k-generator135b-decay20-v1/generator/evaluation/step-6000/random-seed-4.jsonConfiguration134.2 KB
iclr-debug-tokenizer13k-generator135b-decay20-v1/generator/evaluation/step-6000/random-seed-4.samples.jsonConfiguration134.6 KB
iclr-debug-tokenizer13k-generator135b-decay20-v1/generator/evaluation/step-6000/summary.jsonConfiguration872 B
iclr-debug-tokenizer13k-generator135b-decay20-v1/manifest.jsonConfiguration29.0 KB
iclr-debug-tokenizer13k-generator135b-v1/ARCHIVE_MANIFEST.jsonConfiguration10.9 KB
iclr-debug-tokenizer13k-generator135b-v1/STOPPED.jsonConfiguration854 B
iclr-debug-tokenizer13k-generator135b-v1/generator/config.yamlConfiguration4.6 KB
iclr-debug-tokenizer13k-generator135b-v1/generator/evaluation/step-12875/EVAL_DONE.jsonConfiguration97 B
iclr-debug-tokenizer13k-generator135b-v1/generator/evaluation/step-12875/random-seed-0.jsonConfiguration135.4 KB
iclr-debug-tokenizer13k-generator135b-v1/generator/evaluation/step-12875/random-seed-0.samples.jsonConfiguration135.7 KB
iclr-debug-tokenizer13k-generator135b-v1/generator/evaluation/step-12875/random-seed-1.jsonConfiguration137.9 KB
iclr-debug-tokenizer13k-generator135b-v1/generator/evaluation/step-12875/random-seed-1.samples.jsonConfiguration138.3 KB
iclr-debug-tokenizer13k-generator135b-v1/generator/evaluation/step-12875/random-seed-2.jsonConfiguration138.4 KB
iclr-debug-tokenizer13k-generator135b-v1/generator/evaluation/step-12875/random-seed-2.samples.jsonConfiguration138.8 KB
iclr-debug-tokenizer13k-generator135b-v1/generator/evaluation/step-12875/random-seed-3.jsonConfiguration137.2 KB
iclr-debug-tokenizer13k-generator135b-v1/generator/evaluation/step-12875/random-seed-3.samples.jsonConfiguration137.6 KB
iclr-debug-tokenizer13k-generator135b-v1/generator/evaluation/step-12875/random-seed-4.jsonConfiguration139.4 KB
iclr-debug-tokenizer13k-generator135b-v1/generator/evaluation/step-12875/random-seed-4.samples.jsonConfiguration139.8 KB
iclr-debug-tokenizer13k-generator135b-v1/generator/evaluation/step-12875/summary.jsonConfiguration866 B
iclr-debug-tokenizer13k-generator135b-v1/generator/evaluation/step-25750/EVAL_DONE.jsonConfiguration97 B
iclr-debug-tokenizer13k-generator135b-v1/generator/evaluation/step-25750/random-seed-0.jsonConfiguration129.3 KB
iclr-debug-tokenizer13k-generator135b-v1/generator/evaluation/step-25750/random-seed-0.samples.jsonConfiguration129.6 KB
iclr-debug-tokenizer13k-generator135b-v1/generator/evaluation/step-25750/random-seed-1.jsonConfiguration132.2 KB
iclr-debug-tokenizer13k-generator135b-v1/generator/evaluation/step-25750/random-seed-1.samples.jsonConfiguration132.6 KB
iclr-debug-tokenizer13k-generator135b-v1/generator/evaluation/step-25750/random-seed-2.jsonConfiguration134.7 KB
iclr-debug-tokenizer13k-generator135b-v1/generator/evaluation/step-25750/random-seed-2.samples.jsonConfiguration135.1 KB
iclr-debug-tokenizer13k-generator135b-v1/generator/evaluation/step-25750/random-seed-3.jsonConfiguration131.3 KB
iclr-debug-tokenizer13k-generator135b-v1/generator/evaluation/step-25750/random-seed-3.samples.jsonConfiguration131.7 KB
iclr-debug-tokenizer13k-generator135b-v1/generator/evaluation/step-25750/random-seed-4.jsonConfiguration134.3 KB
iclr-debug-tokenizer13k-generator135b-v1/generator/evaluation/step-25750/random-seed-4.samples.jsonConfiguration134.7 KB
iclr-debug-tokenizer13k-generator135b-v1/generator/evaluation/step-25750/summary.jsonConfiguration870 B
iclr-debug-tokenizer13k-generator135b-v1/generator/evaluation/step-36000/EVAL_DONE.jsonConfiguration97 B
iclr-debug-tokenizer13k-generator135b-v1/generator/evaluation/step-36000/random-seed-0.jsonConfiguration129.1 KB
iclr-debug-tokenizer13k-generator135b-v1/generator/evaluation/step-36000/random-seed-0.samples.jsonConfiguration129.5 KB
iclr-debug-tokenizer13k-generator135b-v1/generator/evaluation/step-36000/random-seed-1.jsonConfiguration133.0 KB
iclr-debug-tokenizer13k-generator135b-v1/generator/evaluation/step-36000/random-seed-1.samples.jsonConfiguration133.4 KB
iclr-debug-tokenizer13k-generator135b-v1/generator/evaluation/step-36000/random-seed-2.jsonConfiguration133.5 KB
iclr-debug-tokenizer13k-generator135b-v1/generator/evaluation/step-36000/random-seed-2.samples.jsonConfiguration133.9 KB
iclr-debug-tokenizer13k-generator135b-v1/generator/evaluation/step-36000/random-seed-3.jsonConfiguration132.1 KB
iclr-debug-tokenizer13k-generator135b-v1/generator/evaluation/step-36000/random-seed-3.samples.jsonConfiguration132.4 KB
iclr-debug-tokenizer13k-generator135b-v1/generator/evaluation/step-36000/random-seed-4.jsonConfiguration134.7 KB
iclr-debug-tokenizer13k-generator135b-v1/generator/evaluation/step-36000/random-seed-4.samples.jsonConfiguration135.1 KB
iclr-debug-tokenizer13k-generator135b-v1/generator/evaluation/step-36000/summary.jsonConfiguration867 B
iclr-debug-tokenizer13k-generator135b-v1/generator/evaluation/step-6000/EVAL_DONE.jsonConfiguration96 B
iclr-debug-tokenizer13k-generator135b-v1/generator/evaluation/step-6000/random-seed-0.jsonConfiguration133.4 KB
iclr-debug-tokenizer13k-generator135b-v1/generator/evaluation/step-6000/random-seed-0.samples.jsonConfiguration133.8 KB
iclr-debug-tokenizer13k-generator135b-v1/generator/evaluation/step-6000/random-seed-1.jsonConfiguration136.4 KB
iclr-debug-tokenizer13k-generator135b-v1/generator/evaluation/step-6000/random-seed-1.samples.jsonConfiguration136.8 KB
iclr-debug-tokenizer13k-generator135b-v1/generator/evaluation/step-6000/random-seed-2.jsonConfiguration137.4 KB
iclr-debug-tokenizer13k-generator135b-v1/generator/evaluation/step-6000/random-seed-2.samples.jsonConfiguration137.8 KB
iclr-debug-tokenizer13k-generator135b-v1/generator/evaluation/step-6000/random-seed-3.jsonConfiguration134.3 KB
iclr-debug-tokenizer13k-generator135b-v1/generator/evaluation/step-6000/random-seed-3.samples.jsonConfiguration134.7 KB
iclr-debug-tokenizer13k-generator135b-v1/generator/evaluation/step-6000/random-seed-4.jsonConfiguration136.7 KB
iclr-debug-tokenizer13k-generator135b-v1/generator/evaluation/step-6000/random-seed-4.samples.jsonConfiguration137.1 KB
iclr-debug-tokenizer13k-generator135b-v1/generator/evaluation/step-6000/summary.jsonConfiguration865 B
iclr-debug-tokenizer13k-generator135b-v1/generator/progress.jsonConfiguration409 B
iclr-debug-tokenizer13k-generator135b-v1/git-provenance.jsonConfiguration59 B
iclr-debug-tokenizer13k-generator135b-v1/manifest.jsonConfiguration28.9 KB
iclr-debug-two-stage-135b-20260916/generator/backup-manifest-step-12875.jsonConfiguration9.6 KB
iclr-debug-two-stage-135b-20260916/generator/backup-manifest-step-22000.jsonConfiguration21.6 KB
iclr-debug-two-stage-135b-20260916/generator/config.yamlConfiguration4.6 KB
iclr-debug-two-stage-135b-20260916/generator/evaluation/step-12875-fp32/EVAL_DONE.jsonConfiguration105 B
iclr-debug-two-stage-135b-20260916/generator/evaluation/step-12875-fp32/comparison-to-step-6000.jsonConfiguration463 B
iclr-debug-two-stage-135b-20260916/generator/evaluation/step-12875-fp32/evaluator-provenance.jsonConfiguration280 B
iclr-debug-two-stage-135b-20260916/generator/evaluation/step-12875-fp32/random-seed-0.jsonConfiguration139.9 KB
iclr-debug-two-stage-135b-20260916/generator/evaluation/step-12875-fp32/random-seed-0.samples.jsonConfiguration140.3 KB
iclr-debug-two-stage-135b-20260916/generator/evaluation/step-12875-fp32/random-seed-1.jsonConfiguration141.0 KB
iclr-debug-two-stage-135b-20260916/generator/evaluation/step-12875-fp32/random-seed-1.samples.jsonConfiguration141.4 KB
iclr-debug-two-stage-135b-20260916/generator/evaluation/step-12875-fp32/random-seed-2.jsonConfiguration142.3 KB
iclr-debug-two-stage-135b-20260916/generator/evaluation/step-12875-fp32/random-seed-2.samples.jsonConfiguration142.7 KB
iclr-debug-two-stage-135b-20260916/generator/evaluation/step-12875-fp32/random-seed-3.jsonConfiguration138.8 KB
iclr-debug-two-stage-135b-20260916/generator/evaluation/step-12875-fp32/random-seed-3.samples.jsonConfiguration139.2 KB
iclr-debug-two-stage-135b-20260916/generator/evaluation/step-12875-fp32/random-seed-4.jsonConfiguration142.4 KB
iclr-debug-two-stage-135b-20260916/generator/evaluation/step-12875-fp32/random-seed-4.samples.jsonConfiguration142.8 KB
iclr-debug-two-stage-135b-20260916/generator/evaluation/step-12875-fp32/summary.jsonConfiguration969 B
iclr-debug-two-stage-135b-20260916/generator/evaluation/step-22000-fp32-fp64/EVAL_DONE.jsonConfiguration129 B
iclr-debug-two-stage-135b-20260916/generator/evaluation/step-22000-fp32-fp64/FP32_DONE.jsonConfiguration105 B
iclr-debug-two-stage-135b-20260916/generator/evaluation/step-22000-fp32-fp64/command-seed-0.jsonConfiguration850 B
iclr-debug-two-stage-135b-20260916/generator/evaluation/step-22000-fp32-fp64/command-seed-1.jsonConfiguration850 B
iclr-debug-two-stage-135b-20260916/generator/evaluation/step-22000-fp32-fp64/command-seed-2.jsonConfiguration850 B
iclr-debug-two-stage-135b-20260916/generator/evaluation/step-22000-fp32-fp64/command-seed-3.jsonConfiguration850 B
iclr-debug-two-stage-135b-20260916/generator/evaluation/step-22000-fp32-fp64/command-seed-4.jsonConfiguration850 B
iclr-debug-two-stage-135b-20260916/generator/evaluation/step-22000-fp32-fp64/comparison.jsonConfiguration2.5 KB
iclr-debug-two-stage-135b-20260916/generator/evaluation/step-22000-fp32-fp64/eval_random_gen_ppl_checkpoint_fixed.pyConfiguration7.2 KB
iclr-debug-two-stage-135b-20260916/generator/evaluation/step-22000-fp32-fp64/evaluator-provenance.jsonConfiguration524 B
iclr-debug-two-stage-135b-20260916/generator/evaluation/step-22000-fp32-fp64/fp64-precision-audit.jsonConfiguration536 B
iclr-debug-two-stage-135b-20260916/generator/evaluation/step-22000-fp32-fp64/fp64-seed-0.jsonConfiguration137.0 KB
iclr-debug-two-stage-135b-20260916/generator/evaluation/step-22000-fp32-fp64/fp64-seed-0.per-example.jsonConfiguration7.3 KB
iclr-debug-two-stage-135b-20260916/generator/evaluation/step-22000-fp32-fp64/fp64-seed-1.jsonConfiguration140.0 KB
iclr-debug-two-stage-135b-20260916/generator/evaluation/step-22000-fp32-fp64/fp64-seed-1.per-example.jsonConfiguration7.2 KB
iclr-debug-two-stage-135b-20260916/generator/evaluation/step-22000-fp32-fp64/fp64-seed-2.jsonConfiguration141.2 KB
iclr-debug-two-stage-135b-20260916/generator/evaluation/step-22000-fp32-fp64/fp64-seed-2.per-example.jsonConfiguration7.3 KB
iclr-debug-two-stage-135b-20260916/generator/evaluation/step-22000-fp32-fp64/fp64-seed-3.jsonConfiguration136.3 KB
iclr-debug-two-stage-135b-20260916/generator/evaluation/step-22000-fp32-fp64/fp64-seed-3.per-example.jsonConfiguration7.2 KB
iclr-debug-two-stage-135b-20260916/generator/evaluation/step-22000-fp32-fp64/fp64-seed-4.jsonConfiguration139.4 KB
iclr-debug-two-stage-135b-20260916/generator/evaluation/step-22000-fp32-fp64/fp64-seed-4.per-example.jsonConfiguration7.3 KB
iclr-debug-two-stage-135b-20260916/generator/evaluation/step-22000-fp32-fp64/limited_eval.pyConfiguration722 B
iclr-debug-two-stage-135b-20260916/generator/evaluation/step-22000-fp32-fp64/random-seed-0.jsonConfiguration136.5 KB
iclr-debug-two-stage-135b-20260916/generator/evaluation/step-22000-fp32-fp64/random-seed-0.memory.jsonConfiguration129 B
iclr-debug-two-stage-135b-20260916/generator/evaluation/step-22000-fp32-fp64/random-seed-0.samples.jsonConfiguration136.9 KB
iclr-debug-two-stage-135b-20260916/generator/evaluation/step-22000-fp32-fp64/random-seed-1.jsonConfiguration139.6 KB
iclr-debug-two-stage-135b-20260916/generator/evaluation/step-22000-fp32-fp64/random-seed-1.memory.jsonConfiguration129 B
iclr-debug-two-stage-135b-20260916/generator/evaluation/step-22000-fp32-fp64/random-seed-1.samples.jsonConfiguration139.9 KB
iclr-debug-two-stage-135b-20260916/generator/evaluation/step-22000-fp32-fp64/random-seed-2.jsonConfiguration140.7 KB
iclr-debug-two-stage-135b-20260916/generator/evaluation/step-22000-fp32-fp64/random-seed-2.memory.jsonConfiguration129 B
iclr-debug-two-stage-135b-20260916/generator/evaluation/step-22000-fp32-fp64/random-seed-2.samples.jsonConfiguration141.1 KB
iclr-debug-two-stage-135b-20260916/generator/evaluation/step-22000-fp32-fp64/random-seed-3.jsonConfiguration135.8 KB
iclr-debug-two-stage-135b-20260916/generator/evaluation/step-22000-fp32-fp64/random-seed-3.memory.jsonConfiguration129 B
iclr-debug-two-stage-135b-20260916/generator/evaluation/step-22000-fp32-fp64/random-seed-3.samples.jsonConfiguration136.2 KB
iclr-debug-two-stage-135b-20260916/generator/evaluation/step-22000-fp32-fp64/random-seed-4.jsonConfiguration138.9 KB
iclr-debug-two-stage-135b-20260916/generator/evaluation/step-22000-fp32-fp64/random-seed-4.memory.jsonConfiguration129 B
iclr-debug-two-stage-135b-20260916/generator/evaluation/step-22000-fp32-fp64/random-seed-4.samples.jsonConfiguration139.3 KB
iclr-debug-two-stage-135b-20260916/generator/evaluation/step-22000-fp32-fp64/rescore_fp64.pyConfiguration7.2 KB
iclr-debug-two-stage-135b-20260916/generator/evaluation/step-22000-fp32-fp64/run_evaluation.pyConfiguration2.7 KB
iclr-debug-two-stage-135b-20260916/generator/evaluation/step-22000-fp32-fp64/summary-fp64.jsonConfiguration966 B
iclr-debug-two-stage-135b-20260916/generator/evaluation/step-22000-fp32-fp64/summary.jsonConfiguration966 B
iclr-debug-two-stage-135b-20260916/generator/evaluation/step-25750/EVAL_DONE.jsonConfiguration97 B
iclr-debug-two-stage-135b-20260916/generator/evaluation/step-25750/random-seed-0.jsonConfiguration139.9 KB
iclr-debug-two-stage-135b-20260916/generator/evaluation/step-25750/random-seed-0.samples.jsonConfiguration140.3 KB
iclr-debug-two-stage-135b-20260916/generator/evaluation/step-25750/random-seed-1.jsonConfiguration140.7 KB
iclr-debug-two-stage-135b-20260916/generator/evaluation/step-25750/random-seed-1.samples.jsonConfiguration141.1 KB
iclr-debug-two-stage-135b-20260916/generator/evaluation/step-25750/random-seed-2.jsonConfiguration142.0 KB
iclr-debug-two-stage-135b-20260916/generator/evaluation/step-25750/random-seed-2.samples.jsonConfiguration142.4 KB
iclr-debug-two-stage-135b-20260916/generator/evaluation/step-25750/random-seed-3.jsonConfiguration137.4 KB
iclr-debug-two-stage-135b-20260916/generator/evaluation/step-25750/random-seed-3.samples.jsonConfiguration137.8 KB
iclr-debug-two-stage-135b-20260916/generator/evaluation/step-25750/random-seed-4.jsonConfiguration143.0 KB
iclr-debug-two-stage-135b-20260916/generator/evaluation/step-25750/random-seed-4.samples.jsonConfiguration143.4 KB
iclr-debug-two-stage-135b-20260916/generator/evaluation/step-25750/summary.jsonConfiguration859 B
iclr-debug-two-stage-135b-20260916/generator/exports/step-12875/ncp-config.yamlConfiguration3.5 KB
iclr-debug-two-stage-135b-20260916/generator/exports/step-12875/vqvae-config.yamlConfiguration2.2 KB
iclr-debug-two-stage-135b-20260916/generator/exports/step-22000/ncp-config.yamlConfiguration3.5 KB
iclr-debug-two-stage-135b-20260916/generator/exports/step-22000/training-config.yamlConfiguration4.6 KB
iclr-debug-two-stage-135b-20260916/generator/exports/step-22000/vqvae-config.yamlConfiguration2.2 KB
iclr-debug-two-stage-135b-20260916/generator/exports/step-44000/ncp-config.yamlConfiguration3.5 KB
iclr-debug-two-stage-135b-20260916/generator/exports/step-44000/vqvae-config.yamlConfiguration2.2 KB
iclr-debug-two-stage-135b-20260916/generator/exports/step-45000/ncp-config.yamlConfiguration3.5 KB
iclr-debug-two-stage-135b-20260916/generator/exports/step-45000/vqvae-config.yamlConfiguration2.2 KB
iclr-debug-two-stage-135b-20260916/generator/stopped-20260917/STOPPED.jsonConfiguration397 B
iclr-debug-two-stage-135b-20260916/generator/stopped-20260917/STOP_REQUESTED.jsonConfiguration1.0 KB
iclr-debug-two-stage-135b-20260916/generator/stopped-20260917/backup-manifest.jsonConfiguration14.0 KB
iclr-debug-two-stage-135b-20260916/generator/stopped-20260917/config.yamlConfiguration4.6 KB
iclr-debug-two-stage-135b-20260916/generator/stopped-20260917/git-provenance.jsonConfiguration59 B
iclr-debug-two-stage-135b-20260916/generator/stopped-20260917/manifest.jsonConfiguration35.2 KB
iclr-debug-two-stage-135b-20260916/generator/stopped-20260917/progress.jsonConfiguration402 B
iclr-debug-two-stage-135b-20260916/generator/stopped-20260917/validation-curve.jsonConfiguration12.0 KB
iclr-debug-two-stage-135b-20260916/tokenizer/backup-manifest.jsonConfiguration4.2 KB
iclr-debug-two-stage-135b-20260916/tokenizer/exports/step-128747/config.yamlConfiguration2.2 KB
iclr-debug-two-stage-135b-20260916/tokenizer/exports/step-13000/config.yamlConfiguration2.2 KB
NCM-BUDGET-AUDIT.mdDocumentation4.4 KB
README.mdDocumentation826 B
iclr-debug-decoder-135b-20260916/decoder-mstok/checkpoint-28000-README.mdDocumentation1.6 KB
iclr-debug-decoder-135b-20260916/decoder-mstok/evaluation/step-28000-fp64/report.mdDocumentation3.4 KB
iclr-debug-generator-decay27b-20260917/README.mdDocumentation2.1 KB
iclr-debug-two-stage-135b-20260916/generator/README.mdDocumentation1.8 KB
iclr-debug-two-stage-135b-20260916/generator/evaluation/step-12875-fp32/README.mdDocumentation1.6 KB
iclr-debug-two-stage-135b-20260916/generator/evaluation/step-22000-fp32-fp64/README.mdDocumentation2.0 KB
iclr-debug-two-stage-135b-20260916/generator/stopped-20260917/README.mdDocumentation1.4 KB
iclr-debug-two-stage-135b-20260916/tokenizer/README.mdDocumentation1.4 KB
iclr-debug-generator-decay27b-20260917/launch.shOther665 B
iclr-debug-generator-decay27b-20260917/source.patchOther16.4 KB
iclr-debug-two-stage-135b-20260916/generator/evaluation/step-12875-fp32/evaluation-precision-fix.patchOther1.5 KB
iclr-debug-two-stage-135b-20260916/generator/evaluation/step-22000-fp32-fp64/evaluation-precision.patchOther3.9 KB
iclr-debug-two-stage-135b-20260916/generator/stopped-20260917/training-to-12875.logOther507.9 KB
iclr-debug-two-stage-135b-20260916/generator/stopped-20260917/training-to-25750.logOther803.6 KB
iclr-debug-two-stage-135b-20260916/generator/stopped-20260917/training-to-4769.logOther242.5 KB
iclr-debug-two-stage-135b-20260916/generator/stopped-20260917/training-to-51499.logOther1.2 MB
iclr-debug-two-stage-135b-20260916/generator/stopped-20260917/training-to-954.logOther67.2 KB
.gitattributesRepository1.5 KB

License and Download

License
Not stated by the source
Access
Open weights, no gate
Download size
80.8 GB
Download from Ishan Khare

Released by Ishan Khare through its official repository on Hugging Face.

Memory Requirements

PrecisionWeights in memory
As published80.8 GB

Weights only, from the published parameter count; the key-value cache and runtime add to this.

Similar Models

Fine-tune Qwen3 (14B) for free using our Google Colab notebook! - Read our Blog about Qwen3 support: unsloth.ai/blog/qwen3 - View the rest of our notebooks in our docs here. Qwen3-Coder is available in multiple sizes. Today, we're excited to introduce Qwen3-Coder-30B-A3B-Instruct. This streamlined model maintains impressive performance and efficiency, featuring the following key enhancements: - Significant Performance among open models on Agentic Coding, Agentic Browser-Use, and other foundational coding tasks. - Long-context Capabilities with native support for 256K tokens, extendable up to 1M tokens using Yarn, optimized for repository-scale understanding. - Agentic Coding supporting for…

Open weights apache-2.0 transformers

Model · Text generation

opt-125m

AI at Meta

OPT was first introduced in Open Pre-trained Transformer Language Models and first released in metaseq's repository on May 3rd 2022 by Meta AI. Disclaimer: The team releasing OPT wrote an official model card, which is available in Appendix D of the paper. Content from this model card has been written by the Hugging Face team. To quote the first two paragraphs of the official paper OPT was predominantly pretrained with English text, but a small amount of non-English data is still present within the training corpus via CommonCrawl. The model was pretrained using a causal language modeling (CLM) objective. OPT belongs to the same family of decoder-only models like GPT-3. As such, it was…

Open weights other 2,048 tokens transformers

Model · Text generation

Ornith-1.5-9B-GGUF

Ornith

Chirp Chirp! We are introducing Ornith-1.5, a major step toward building foundation models through end-to-end self-improvement. Ornith-1.5 extends Ornith-1.0 (which was developed on top of Qwen3.5 and Gemma4 with additional continued pretraining, mid-training, and post-training) by expanding the self-improvement loop from scaffold and rollout optimization to jointly optimizing task generation, scaffold construction, and solution rollouts. Rather than relying on a fixed set of human-curated tasks and manually designed harnesses, Ornith-1.5 continuously generates new training tasks, discovers effective strategies for solving them, and improves the policy through reinforcement learning. For…

Open weights mit transformers

Model · Text generation

Ornith-1.5-35B-A3B-GGUF

Ornith

Chirp Chirp! We are introducing Ornith-1.5, a major step toward building foundation models through end-to-end self-improvement. Ornith-1.5 extends Ornith-1.0 (which was developed on top of Qwen3.5 and Gemma4 with additional continued pretraining, mid-training, and post-training) by expanding the self-improvement loop from scaffold and rollout optimization to jointly optimizing task generation, scaffold construction, and solution rollouts. Rather than relying on a fixed set of human-curated tasks and manually designed harnesses, Ornith-1.5 continuously generates new training tasks, discovers effective strategies for solving them, and improves the policy through reinforcement learning. For…

Open weights mit transformers

Model · Text generation

Ornith-1.0-9B-GGUF

Ornith

Aloha! Today, we are releasing Ornith-1.0, a self-improving family of open-source models for agentic coding. This model card documents Ornith-1.0-9B, the most lightweight member of the Ornith family, designed for efficient single-GPU deployment. Ornith-1.0-9B is a dense ~9B model (≈19 GB in bf16), so it serves comfortably on a single 80GB GPU. The recipes below stand up an OpenAI-compatible server; add --tensor-parallel-size / --tp if you want to shard across more GPUs. For a quick local test (or to script offline generation), load the model directly with Transformers. Make sure you have a recent release installed — see the Transformers installation guide; Ornith-1.0-9B requires…

Open weights mit transformers

Uncensored Qwen3.8-27B, published as GGUF quantizations with the multi token prediction (MTP) head retained and verified. Refusal behaviour has been substantially reduced, not eliminated. See Measured behaviour for the numbers. Capabilities, training data, and architecture are otherwise unchanged. - Refusal directions removed with Heretic, which co minimizes refusal count against KL divergence from the base model. No handwritten refusal removal code, no finetuning, no additional training data. - Abliteration runs at bf16 (no 4 bit quantization). the resulting LoRA is merged into the bf16 base, so the published weights are not a quantized round trip. - mtp. tensors are copied verbatim from…

Open weights apache-2.0 llama.cpp