SAVRN
Search Contact SAVRN

Open-weight model · Text generation

ovd-math-1-data-full-step300-historical

by Jing Xiong menik1126/ovd-math-1-data-full-step300-historical

ovd-math-1-data-full-step300-historical is an open-weight model for text generation from Jing Xiong. It has 1.8B parameters and a 4,096-token context. At 16-bit it needs about 4.3 GB of GPU memory, which fits on 1x MI300X from $1.85 an hour, at the lowest prices in the SAVRN Index.

Inference weights and tokenizer for the historical 1-data experiment. Part of the OVD collection.

Parameters1.8B
Context4,096
Weights7.1 GB
License
AccessOpen weights
Monthly Downloads

Runs On

What it takes to serve ovd-math-1-data-full-step300-historical (1.8B parameters): the memory its weights need at each precision, and the cheapest way to rent enough data-center GPUs to hold them.

PrecisionWeightsMemory neededCheapest setupPer hourAlso fits
16-bit 3.6 GB 4.3 GB 1x MI300X (192 GB)
Vultr
$1.85 1x H100 $1.99 · 1x MI325X $2.00
8-bit 1.8 GB 2.1 GB 1x MI300X (192 GB)
Vultr
$1.85 1x H100 $1.99 · 1x MI325X $2.00
4-bit 0.9 GB 1.1 GB 1x MI300X (192 GB)
Vultr
$1.85 1x H100 $1.99 · 1x MI325X $2.00

Memory is the weights at that precision plus 20% for the runtime and a short context; a long context needs more. Prices are the lowest on-demand hourly rates in the SAVRN Index, read Sep 20, 2026.

ovd-math-1-data-full-step300-historical on every accelerator the SAVRN Index prices, at every precision

Model Card

Inference weights and tokenizer for the historical 1-data experiment. Part of the OVD collection.

Excerpt from the card by Jing Xiong.

Configuration

Architecture
Qwen2ForCausalLM
Context length (tokens)
4,096
Layers
28
Hidden size
1,536
Feed-forward size
8,960
Attention heads
12
Key/value heads
2
Vocabulary size
151,936
RoPE base
10,000
Stored precision
float32
Model type
qwen2

Identity and Version

Repository
menik1126/ovd-math-1-data-full-step300-historical
Publisher
Jing Xiong
Task
Text generation
Modality
Text
Library
transformers
Parameters
1.8B parameters
Languages
Not stated by the source
Revision
8519182a5f9867a036f340b4a0b9b88637df38a2
First published
2026-09-20
Last updated
2026-09-20

Files and Weights

14 files, 7.1 GB in total. The weights are 2 files totalling 7.1 GB in safetensors.

Weights2 files · 7.1 GB
Configuration6 files · 31.4 KB
Tokenizer4 files · 15.9 MB
Documentation1 file · 307 B
Repository1 file · 1.6 KB
Every file
FileTypeSizeSHA-256
model-00001-of-00002.safetensorsWeights5.0 GB a43e386c6bbf
model-00002-of-00002.safetensorsWeights2.1 GB 0cb7d367a848
added_tokens.jsonConfiguration605 B
config.jsonConfiguration843 B
generation_config.jsonConfiguration117 B
model.safetensors.index.jsonConfiguration27.8 KB
provenance.jsonConfiguration1.4 KB
special_tokens_map.jsonConfiguration616 B
README.mdDocumentation307 B
.gitattributesRepository1.6 KB
merges.txtTokenizer1.7 MB
tokenizer.jsonTokenizer11.4 MB 9c5ae00e602b
tokenizer_config.jsonTokenizer7.3 KB
vocab.jsonTokenizer2.8 MB

License and Download

License
Not stated by the source
Access
Open weights, no gate
Download size
7.1 GB
Download from Jing Xiong

Released by Jing Xiong through its official repository on Hugging Face.

Built From

  • Derived from Qwen/Qwen2.5-Math-1.5B

Memory Requirements

PrecisionWeights in memory
As published7.1 GB
16-bit3.6 GB
8-bit1.8 GB
4-bit0.9 GB

Weights only, from the published parameter count; the key-value cache and runtime add to this.

Questions About ovd-math-1-data-full-step300-historical

How much GPU memory does ovd-math-1-data-full-step300-historical need?

About 4.3 GB at 16-bit and 1.1 GB at 4-bit: the weights (1.8B parameters) plus a working margin. A long context needs more.

What is the cheapest GPU to run ovd-math-1-data-full-step300-historical on?

At 16-bit, 1x MI300X from $1.85 an hour; at 4-bit, 1x MI300X from $1.85 an hour, at the lowest on-demand prices the SAVRN Index lists.

What is ovd-math-1-data-full-step300-historical's context length?

4,096 tokens, from the maximum position embeddings in its published configuration.

Similar Models

A fast and efficient ~1.5B model optimized for CPU inference. The model was refactored with BitNet features and an updated tokenizer that includes new Routing, Tool call, and Robotics tags. Built on a redesigned DeepSeek R1 architecture with native ternary (BitNet-style) support and ready-to-run GGUF quantizations. - JiRack is a cloud-ready model that helps save money on cloud infrastructure. It can be used as an expert model in RAG deployments, with the ONNX JiRack Java server as an alternative. - Benefits high quality CPU inference TQ2 on Llama.cpp and Ollama via QAT - Robotcs, Routing, Coding, Multimedia, Advanced tool calling via CMSManhattan/JiRackPrecisionTokenizer - We are working to…

Open weights mit 1.8B parameters 131,072 tokens

Model · Text generation

Bonsai-27B-mlx-1bit

Prism ML

Full 27B-class reasoning in binary transformer weights — the first 27B-class model to run on a phone - ~3.9 GB deployed footprint (down from ~54 GB FP16) — fits within the per-app memory budget of a high-end phone such as the iPhone 17 Pro Max - Retains thinking, reasoning, and agentic behavior deep in the sub-4-bit regime, where conventional low-bit representations collapse — 76.11 average across 15 thinking-mode benchmarks (89.5% of FP16), including math at 91.66 and coding at 81.88 - End-to-end binary language weights across embeddings, attention projections, MLP projections, and LM head, at a true 1.125 bits per weight — no high-precision escape hatches behind a low-bit label; the…

Open weights apache-2.0 1.7B parameters 262,144 tokens mlx

Model · Text generation

Qwen3-1.7B-Base

Qwen

Qwen3 is the latest generation of large language models in Qwen series, offering a comprehensive suite of dense and mixture-of-experts (MoE) models. Building upon extensive advancements in training data, model architecture, and optimization techniques, Qwen3 delivers the following key improvements over the previously released Qwen2.5: Qwen3-1.7B-Base has the following features: For more details, including benchmark evaluation, hardware requirements, and inference performance, please refer to our blog, GitHub, and Documentation. The code of Qwen3 has been in the latest Hugging Face transformers and we advise you to use the latest version of transformers. With transformers<4.51.0, you will…

Open weights apache-2.0 1.7B parameters 32,768 tokens transformers

DualMind TKD Agentic 1.7B is a two-stage derivative of Qwen/Qwen3-1.7B. It combines topology-guided mathematical knowledge distillation with assistant-masked agentic and function-calling specialization. teacher distillation topology, gap-energy diagnostics, and phase-weighted Explore/Examine/Response supervision Stage 1 was designed to transfer mathematical reasoning behavior while placing additional learning pressure on derivation, verification, and high-discrepancy reasoning transitions. - Tool schemas, user messages, and tool-result messages were visible as context but excluded from direct loss - Mathematical replay was mixed into Stage 2 to reduce catastrophic forgetting The files in…

Open weights other 1.7B parameters 40,960 tokens transformers

Model · Text generation

dQwen3-1.7B-Base

IFML

A masked diffusion language model adapted from Qwen3-1.7B. The backbone is full attention, and every layer is made bidirectional. It is the control model in the paper's matched comparison against the hybrid dQwen3.5-2B. This is a base model, with no instruction tuning. Paper: dQwen3.5: Hybrid-Attention Diffusion Language Models. Code: https://github.com/AntonXue/dQwen Needs a CUDA GPU and transformers>=5.13 (tested with torch 2.7.1+cu128, flash-linear-attention 0.5.1). generate decodes the whole canvas at once, committing positions above a confidence threshold (tau=0.9); pass blocklength=32 for left-to-right block decoding, or tau=None, stepsperblock=k for a fixed budget. The 50B-token…

Open weights apache-2.0 1.7B parameters 40,960 tokens transformers