Skip to page content
SAVRN
Search Plan a project

Open-weight model · Text generation

CEDR

by Xiang Cheng xc91/CEDR

CEDR is an open-weight model for text generation from Xiang Cheng, released under Apache License 2.0. Its published files total 17.9 GB.

CEDR generates reasoning solutions with continuous latent diffusion and a learned prompt encoder. This repository contains six selected-weight inference packages for GSM8K, MATH500, and coding, before and after NFT.

Parameters—
Context—
Weights17.8 GB
Licenseapache-2.0
AccessOpen weights
Monthly Downloads—

Model Card

By Xiang Cheng, published under apache-2.0, revision cad7c151e8b1.

CEDR generates reasoning solutions with continuous latent diffusion and a learned prompt encoder. This repository contains six selected-weight inference packages for GSM8K, MATH500, and coding, before and after NFT. The training and inference code and installation instructions are at chengxiang/CEDR. All use async clocks (2.5, 2, 1.5), CFG 1, batch size 32, and a 1,024-token diffusion canvas. The GSM8K post-NFT preset caps decoded responses at 767 tokens. Other presets use the canvas available after each prompt. See the code repository's evaluation guide for MATH500 and official HumanEval/MBPP base/plus scoring. Coding generation uses the combined 164 HumanEval and 378 MBPP tasks. Standard…

Read Xiang Cheng's full model card

CEDR: Continuous Embedding Diffusion for Reasoning

CEDR generates reasoning solutions with continuous latent diffusion and a learned prompt encoder. This repository contains six selected-weight inference packages for GSM8K, MATH500, and coding, before and after NFT.

Paper: Reasoning with Continuous Latent Diffusion.

The training and inference code and installation instructions are at chengxiang/CEDR.

Package Selected model / prompt EMA Steps SCCFG
gsm8k-b-pre-nft .9999 / .9999 64 2
gsm8k-b-post-nft .99 / .99 64 2
math-l-pre-nft .9999 / .9999 64 3
math-l-post-nft .99 / .99 64 3
oci-l-pre-nft .9999 / .9999 128 3
oci-l-post-nft .9 / .9 128 3

All use async clocks (2.5, 2, 1.5), CFG 1, batch size 32, and a 1,024-token diffusion canvas. The GSM8K post-NFT preset caps decoded responses at 767 tokens. Other presets use the canvas available after each prompt.

Usage

pip install 'git+https://github.com/chengxiang/CEDR.git#egg=cedr[data,math]'
cedr download --model gsm8k-b-pre-nft --output artifacts/gsm8k-b-pre
cedr prepare-benchmark --benchmark gsm8k --checkpoint artifacts/gsm8k-b-pre --output artifacts/gsm8k-test
cedr generate --checkpoint artifacts/gsm8k-b-pre --data artifacts/gsm8k-test --seed 42 --output artifacts/seed42
cedr score --config artifacts/gsm8k-b-pre/config.json --data artifacts/gsm8k-test --predictions artifacts/seed42/predictions.jsonl --output artifacts/seed42/scoring

See the code repository's evaluation guide for MATH500 and official HumanEval/MBPP base/plus scoring. Coding generation uses the combined 164 HumanEval and 378 MBPP tasks. Standard scoring does not apply function-name repair. The optional --function-name-repair flag produces the separately reported alias-scored comparison; see the evaluation guide.

Contents and numerical settings

Each package has FP32 learned denoiser/vocabulary-decoder weights and prompt-encoder weights in safetensors, architecture and inference configuration, selected-state metadata, and SHA-256 hashes. Keep the matched components together. The single shared BF16 token embedding table and tokenizer come from Qwen3-4B-Instruct-2507, revision cdbee75f17c01a7cc42f958dc650907174af0554. Generation requires no teacher Transformer or training cache. Each package also references a matched representation.pt for joint fine-tuning.

The initial noise stream is CPU-seeded. Euler sampling uses a logit-normal quantile grid with mean -1.5 and standard deviation .8, local clock derivatives, and recurrent self-conditioning. Learned weights and ODE states remain FP32; denoiser Transformer forwards use BF16 and vocabulary projection uses FP32. Math/GSM prompt encoders run in FP32; coding prompt encoders run in BF16 with lengths padded to a multiple of 32.

Generation supports resumption after completed batches. Downloads resolve an immutable Hub revision and verify every file. Use --revision to select a recorded release commit.

Joint fine-tuning

The three bundles under representations/gsm8k-b, representations/math-l, and representations/oci-l contain the exact FP32 centering means, effective whitened encoders, and reconstruction matrices. Each family shares its bundle across pre-NFT and post-NFT models. cedr download places the matched bundle in the model directory and verifies its hash.

Use cedr train joint --init-weights MODEL_DIR to initialize the downloaded ELF/prompt pair with fresh optimizers and independent EMAs. Download the pinned full Qwen teacher separately to encode your training data, using either live extraction or an optional feature cache. Separate covariance artifacts are unnecessary when keeping the representation fixed. See the fine-tuning guide.

License and attribution

Model artifacts are Apache 2.0. The CEDR code is MIT. The frozen embedding table and tokenizer retain Qwen attribution; see LICENSE and NOTICE.

These are task-specific research models. Benchmark correctness is measured by the numerical, symbolic, or execution-based scorer specified for each task.

Release validation

Seed-42 checks; separate from the paper's eight-seed estimates. All predictions and per-problem correctness decisions match.

Model Benchmark Correct / total Pass@1 Plus correct / total Plus pass@1
gsm8k-b-pre-nft gsm8k 523/1319 39.65% — —
gsm8k-b-post-nft gsm8k 554/1319 42.00% — —
math-l-pre-nft math500 103/500 20.60% — —
math-l-post-nft math500 128/500 25.60% — —
oci-l-pre-nft humaneval 49/164 29.88% 46/164 28.05%
oci-l-pre-nft mbpp 70/378 18.52% 61/378 16.14%
oci-l-post-nft humaneval 54/164 32.93% 53/164 32.32%
oci-l-post-nft mbpp 92/378 24.34% 80/378 21.16%

Identity and Version

Repository
xc91/CEDR
Publisher
Xiang Cheng
Task
Text generation
Modality
Text
Library
cedr
Parameters
Not stated by the source
Languages
en
Revision
cad7c151e8b1cf4a4a09cc22b0bbd1372460374c
First published
2026-09-29
Last updated
2026-10-04

Files and Weights

37 files, 17.9 GB in total. The weights are 16 files totalling 17.8 GB in pt, safetensors.

Weights16 files · 17.8 GB
Configuration13 files · 37.7 KB
Tokenizer4 files · 15.9 MB
Documentation3 files · 17.1 KB
Repository1 file · 1.6 KB
Every file
FileTypeSizeSHA-256
models/gsm8k-b-post-nft/model.safetensorsWeights987.9 MB 1fdbdd381f69
models/gsm8k-b-post-nft/prompt.safetensorsWeights180.1 MB 3658fd27177b
models/gsm8k-b-pre-nft/model.safetensorsWeights987.9 MB a1dc71f610b7
models/gsm8k-b-pre-nft/prompt.safetensorsWeights180.1 MB bb2fdb56099a
models/math-l-post-nft/model.safetensorsWeights3.2 GB f125d355020c
models/math-l-post-nft/prompt.safetensorsWeights485.3 MB a978c3cfb86b
models/math-l-pre-nft/model.safetensorsWeights3.2 GB e4b93224ecdd
models/math-l-pre-nft/prompt.safetensorsWeights485.3 MB ab19b3d718aa
models/oci-l-post-nft/model.safetensorsWeights3.2 GB d13114ec204a
models/oci-l-post-nft/prompt.safetensorsWeights485.3 MB e4ac5d1dd157
models/oci-l-pre-nft/model.safetensorsWeights3.2 GB e89e0e400478
models/oci-l-pre-nft/prompt.safetensorsWeights485.3 MB 93bb340d5ebf
representations/gsm8k-b/representation.ptWeights21.0 MB ea4928f15922
representations/math-l/representation.ptWeights21.0 MB ed1d26ac4811
representations/oci-l/representation.ptWeights21.0 MB 5d2cfb5f95be
shared/embedding.safetensorsWeights777.9 MB bc1a0007dd96
index.jsonConfiguration15.6 KB —
models/gsm8k-b-post-nft/config.jsonConfiguration1.7 KB —
models/gsm8k-b-post-nft/manifest.jsonConfiguration2.0 KB —
models/gsm8k-b-pre-nft/config.jsonConfiguration1.7 KB —
models/gsm8k-b-pre-nft/manifest.jsonConfiguration2.0 KB —
models/math-l-post-nft/config.jsonConfiguration1.7 KB —
models/math-l-post-nft/manifest.jsonConfiguration2.0 KB —
models/math-l-pre-nft/config.jsonConfiguration1.7 KB —
models/math-l-pre-nft/manifest.jsonConfiguration2.0 KB —
models/oci-l-post-nft/config.jsonConfiguration1.7 KB —
models/oci-l-post-nft/manifest.jsonConfiguration2.0 KB —
models/oci-l-pre-nft/config.jsonConfiguration1.7 KB —
models/oci-l-pre-nft/manifest.jsonConfiguration2.0 KB —
LICENSEDocumentation11.3 KB —
NOTICEDocumentation441 B —
README.mdDocumentation5.3 KB —
.gitattributesRepository1.6 KB —
shared/tokenizer/merges.txtTokenizer1.7 MB —
shared/tokenizer/tokenizer.jsonTokenizer11.4 MB aeb13307a71a
shared/tokenizer/tokenizer_config.jsonTokenizer9.4 KB —
shared/tokenizer/vocab.jsonTokenizer2.8 MB —

License and Download

License
apache-2.0
Access
Open weights, no gate
Download size
17.8 GB
Download from Xiang Cheng

Released by Xiang Cheng through its official repository on Hugging Face. Read the license.

Built From

Memory Requirements

PrecisionWeights in memory
As published17.8 GB

Weights only, from the published parameter count; the key-value cache and runtime add to this.

Questions About CEDR

Can I use CEDR commercially?

Yes. CEDR is released under Apache License 2.0. The Apache License 2.0 is a permissive open-source license. It permits commercial use, modification and redistribution. It requires keeping the license and copyright notices and any NOTICE file, stating significant changes, and it includes an express patent grant from contributors.

Similar Models

Model · Text generation

opt-125m

AI at Meta

OPT was first introduced in Open Pre-trained Transformer Language Models and first released in metaseq's repository on May 3rd 2022 by Meta AI. Disclaimer: The team releasing OPT wrote an official model card, which is available in Appendix D of the paper. Content from this model card has been written by the Hugging Face team. To quote the first two paragraphs of the official paper OPT was predominantly pretrained with English text, but a small amount of non-English data is still present within the training corpus via CommonCrawl. The model was pretrained using a causal language modeling (CLM) objective. OPT belongs to the same family of decoder-only models like GPT-3. As such, it was…

Open weights other 2,048 tokens transformers

Model · Text generation

Ornith-1.5-9B-GGUF

Ornith

Chirp Chirp! We are introducing Ornith-1.5, a major step toward building foundation models through end-to-end self-improvement. Ornith-1.5 extends Ornith-1.0 (which was developed on top of Qwen3.5 and Gemma4 with additional continued pretraining, mid-training, and post-training) by expanding the self-improvement loop from scaffold and rollout optimization to jointly optimizing task generation, scaffold construction, and solution rollouts. Rather than relying on a fixed set of human-curated tasks and manually designed harnesses, Ornith-1.5 continuously generates new training tasks, discovers effective strategies for solving them, and improves the policy through reinforcement learning. For…

Open weights mit transformers

Model · Text generation

Ternary-Bonsai-2-27B-gguf

Prism ML

Full 27B-class reasoning in ternary transformer weights, for llama.cpp (CUDA, Metal, CPU) - \~5.9 GB language model (down from \~54 GB FP16) — full 27B-class reasoning on a standard laptop or a single GPU - 98.2% of FP16 intelligence retained: 84.78 average across 14 thinking-mode benchmarks — far above the conventional IQ2XXS build (72.59) at about 82% of its footprint, and within 0.4 points of UD-Q4KXL at three times the footprint - Retains thinking, reasoning, and agentic behavior deep in the sub-4-bit regime, where conventional low-bit representations collapse: math within half a point of full precision (96.57), coding level with the baseline (89.42), agentic tool calling at 74.92…

Open weights apache-2.0 llama.cpp

Model · Text generation

Ornith-1.5-35B-A3B-GGUF

Ornith

Chirp Chirp! We are introducing Ornith-1.5, a major step toward building foundation models through end-to-end self-improvement. Ornith-1.5 extends Ornith-1.0 (which was developed on top of Qwen3.5 and Gemma4 with additional continued pretraining, mid-training, and post-training) by expanding the self-improvement loop from scaffold and rollout optimization to jointly optimizing task generation, scaffold construction, and solution rollouts. Rather than relying on a fixed set of human-curated tasks and manually designed harnesses, Ornith-1.5 continuously generates new training tasks, discovers effective strategies for solving them, and improves the policy through reinforcement learning. For…

Open weights mit transformers

Uncensored Qwen3.8-27B, published as GGUF quantizations with the multi token prediction (MTP) head retained and verified. Refusal behaviour has been substantially reduced, not eliminated. See Measured behaviour for the numbers. Capabilities, training data, and architecture are otherwise unchanged. - Refusal directions removed with Heretic, which co minimizes refusal count against KL divergence from the base model. No handwritten refusal removal code, no finetuning, no additional training data. - Abliteration runs at bf16 (no 4 bit quantization). the resulting LoRA is merged into the bf16 base, so the published weights are not a quantized round trip. - mtp. tensors are copied verbatim from…

Open weights apache-2.0 llama.cpp

Model · Text generation

Ornith-1.0-9B-GGUF

Ornith

Aloha! Today, we are releasing Ornith-1.0, a self-improving family of open-source models for agentic coding. This model card documents Ornith-1.0-9B, the most lightweight member of the Ornith family, designed for efficient single-GPU deployment. Ornith-1.0-9B is a dense ~9B model (≈19 GB in bf16), so it serves comfortably on a single 80GB GPU. The recipes below stand up an OpenAI-compatible server; add --tensor-parallel-size / --tp if you want to shard across more GPUs. For a quick local test (or to script offline generation), load the model directly with Transformers. Make sure you have a recent release installed — see the Transformers installation guide; Ornith-1.0-9B requires…

Open weights mit transformers