Skip to page content
SAVRN
Search Plan a project

Open-weight model · Text generation

ncm-checkpoints

by HazyResearch hazyresearch/ncm-checkpoints

ncm-checkpoints is an open-weight model for text generation from HazyResearch, released under MIT License. Its published files total 8.0 GB.

Released tokenizer and generator pairs for Next-Concept Modeling. Each folder holds a config.yaml with the architecture and sampling settings and the.pt checkpoints it names.

Parameters—
Context—
Weights8.0 GB
Licensemit
AccessOpen weights
Monthly Downloads—

Model Card

By HazyResearch, published under mit, revision d342ce8aaea5.

Released tokenizer and generator pairs for Next-Concept Modeling. Each folder holds a config.yaml with the architecture and sampling settings and the.pt checkpoints it names.

Read HazyResearch's full model card

Released tokenizer and generator pairs for Next-Concept Modeling. Each folder holds a config.yaml with the architecture and sampling settings and the .pt checkpoints it names.

folder task
xsum/ XSum summarization
wmt14/ WMT14 German-English translation
sudoku/ Sudoku, easy / medium / hard
lm1b/ One Billion Word, small / medium / large with a shared tokenizer
tinystories/ TinyStories
owt/ OpenWebText

Citation

@misc{kumbong2026nextconcept,
  title   = {Next-Concept Modeling: Fast, Parallel Coarse-to-Fine Text Generation},
  author  = {Kumbong, Hermann and Khare, Ishan S. and Mlauzi, Iddah and Woen, Andrew and Ding, Charles and Buchanan, E. Kelly and Arora, Simran and Mirhoseini, Azalia and R{\'e}, Christopher},
  year    = {2026},
  eprint={2610.14162},
  archivePrefix={arXiv},
  primaryClass={cs.CL},
  url={https://arxiv.org/abs/2610.14162},
}

Identity and Version

Repository
hazyresearch/ncm-checkpoints
Publisher
HazyResearch
Task
Text generation
Modality
Text
Library
Not stated by the source
Parameters
Not stated by the source
Languages
Not stated by the source
Revision
d342ce8aaea58830eef3b8ad473664673e41f692
First published
2026-10-13
Last updated
2026-10-16

Files and Weights

35 files, 8.0 GB in total. The weights are 16 files totalling 8.0 GB in pt.

Weights16 files · 8.0 GB
Configuration9 files · 21.2 KB
Documentation7 files · 2.3 KB
Other2 files · 203.4 KB
Repository1 file · 1.5 KB
Every file
FileTypeSizeSHA-256
lm1b/large/generator.ptWeights2.9 GB ec34d6c56a81
lm1b/medium/generator.ptWeights1.3 GB 5aa4621472c2
lm1b/small/generator.ptWeights390.1 MB b0789d5a2aad
lm1b/tokenizer.ptWeights597.8 MB d88aa17b66d7
sudoku/easy/generator.ptWeights102.6 MB 1cefebcd1eae
sudoku/easy/tokenizer.ptWeights59.8 MB 3f9c87e99fd4
sudoku/hard/generator.ptWeights102.6 MB 9e0bfe44abc1
sudoku/hard/tokenizer.ptWeights59.8 MB 3bc6aecad8e1
sudoku/medium/generator.ptWeights102.6 MB 8336b53fa3dc
sudoku/medium/tokenizer.ptWeights59.8 MB aca5523a0c47
tinystories/generator.ptWeights356.2 MB 0acaf4f79539
tinystories/tokenizer.ptWeights221.9 MB 76e26003719d
wmt14/generator.ptWeights480.6 MB ae580cbbb400
wmt14/tokenizer.ptWeights645.8 MB 74f04176a3cd
xsum/generator.ptWeights354.4 MB f152f390253d
xsum/tokenizer.ptWeights299.6 MB 1f806ddaf8e0
lm1b/large/config.yamlConfiguration2.8 KB —
lm1b/medium/config.yamlConfiguration2.8 KB —
lm1b/small/config.yamlConfiguration2.7 KB —
sudoku/easy/config.yamlConfiguration2.0 KB —
sudoku/hard/config.yamlConfiguration2.0 KB —
sudoku/medium/config.yamlConfiguration2.0 KB —
tinystories/config.yamlConfiguration2.5 KB —
wmt14/config.yamlConfiguration2.2 KB —
xsum/config.yamlConfiguration2.3 KB —
README.mdDocumentation1.2 KB —
lm1b/README.mdDocumentation277 B —
owt/TODO.mdDocumentation5 B —
sudoku/README.mdDocumentation140 B —
tinystories/README.mdDocumentation255 B —
wmt14/README.mdDocumentation218 B —
xsum/README.mdDocumentation201 B —
tinystories/bpe_merges_8192.pickleOther108.3 KB 0d4cab13f2e7
tinystories/bpe_vocab_8192.pickleOther95.1 KB fb176b4c6810
.gitattributesRepository1.5 KB —

License and Download

License
mit
Access
Open weights, no gate
Download size
8.0 GB
Download from HazyResearch

Released by HazyResearch through its official repository on Hugging Face. Read the license.

Built From

  • Described by arXiv:2610.14162

Memory Requirements

PrecisionWeights in memory
As published8.0 GB

Weights only, from the published parameter count; the key-value cache and runtime add to this.

Questions About ncm-checkpoints

Can I use ncm-checkpoints commercially?

Yes. ncm-checkpoints is released under MIT License. The MIT License is a short permissive license. It permits commercial use, modification and redistribution, provided the copyright notice and permission notice are included.

Similar Models

Model · Text generation

opt-125m

AI at Meta

OPT was first introduced in Open Pre-trained Transformer Language Models and first released in metaseq's repository on May 3rd 2022 by Meta AI. Disclaimer: The team releasing OPT wrote an official model card, which is available in Appendix D of the paper. Content from this model card has been written by the Hugging Face team. To quote the first two paragraphs of the official paper OPT was predominantly pretrained with English text, but a small amount of non-English data is still present within the training corpus via CommonCrawl. The model was pretrained using a causal language modeling (CLM) objective. OPT belongs to the same family of decoder-only models like GPT-3. As such, it was…

Open weights other 2,048 tokens transformers

Model · Text generation

Ornith-1.5-9B-GGUF

Ornith

Chirp Chirp! We are introducing Ornith-1.5, a major step toward building foundation models through end-to-end self-improvement. Ornith-1.5 extends Ornith-1.0 (which was developed on top of Qwen3.5 and Gemma4 with additional continued pretraining, mid-training, and post-training) by expanding the self-improvement loop from scaffold and rollout optimization to jointly optimizing task generation, scaffold construction, and solution rollouts. Rather than relying on a fixed set of human-curated tasks and manually designed harnesses, Ornith-1.5 continuously generates new training tasks, discovers effective strategies for solving them, and improves the policy through reinforcement learning. For…

Open weights mit transformers

Model · Text generation

Ternary-Bonsai-2-27B-gguf

Prism ML

Full 27B-class reasoning in ternary transformer weights, for llama.cpp (CUDA, Metal, CPU) - \~5.9 GB language model (down from \~54 GB FP16) — full 27B-class reasoning on a standard laptop or a single GPU - 98.2% of FP16 intelligence retained: 84.78 average across 14 thinking-mode benchmarks — far above the conventional IQ2XXS build (72.59) at about 82% of its footprint, and within 0.4 points of UD-Q4KXL at three times the footprint - Retains thinking, reasoning, and agentic behavior deep in the sub-4-bit regime, where conventional low-bit representations collapse: math within half a point of full precision (96.57), coding level with the baseline (89.42), agentic tool calling at 74.92…

Open weights apache-2.0 llama.cpp

Model · Text generation

Ornith-1.5-35B-A3B-GGUF

Ornith

Chirp Chirp! We are introducing Ornith-1.5, a major step toward building foundation models through end-to-end self-improvement. Ornith-1.5 extends Ornith-1.0 (which was developed on top of Qwen3.5 and Gemma4 with additional continued pretraining, mid-training, and post-training) by expanding the self-improvement loop from scaffold and rollout optimization to jointly optimizing task generation, scaffold construction, and solution rollouts. Rather than relying on a fixed set of human-curated tasks and manually designed harnesses, Ornith-1.5 continuously generates new training tasks, discovers effective strategies for solving them, and improves the policy through reinforcement learning. For…

Open weights mit transformers

Uncensored Qwen3.8-27B, published as GGUF quantizations with the multi token prediction (MTP) head retained and verified. Refusal behaviour has been substantially reduced, not eliminated. See Measured behaviour for the numbers. Capabilities, training data, and architecture are otherwise unchanged. - Refusal directions removed with Heretic, which co minimizes refusal count against KL divergence from the base model. No handwritten refusal removal code, no finetuning, no additional training data. - Abliteration runs at bf16 (no 4 bit quantization). the resulting LoRA is merged into the bf16 base, so the published weights are not a quantized round trip. - mtp. tensors are copied verbatim from…

Open weights apache-2.0 llama.cpp

Model · Text generation

Ornith-1.0-9B-GGUF

Ornith

Aloha! Today, we are releasing Ornith-1.0, a self-improving family of open-source models for agentic coding. This model card documents Ornith-1.0-9B, the most lightweight member of the Ornith family, designed for efficient single-GPU deployment. Ornith-1.0-9B is a dense ~9B model (≈19 GB in bf16), so it serves comfortably on a single 80GB GPU. The recipes below stand up an OpenAI-compatible server; add --tensor-parallel-size / --tp if you want to shard across more GPUs. For a quick local test (or to script offline generation), load the model directly with Transformers. Make sure you have a recent release installed — see the Transformers installation guide; Ornith-1.0-9B requires…

Open weights mit transformers