Skip to page content
SAVRN
Search Plan a project

Open-weight model · Text generation

Qwen2.5-3B-Instruct-Sheldon-RLVR-math-v1

by Sam EnMin Huang tbooy/Qwen2.5-3B-Instruct-Sheldon-RLVR-math-v1

Qwen2.5-3B-Instruct-Sheldon-RLVR-math-v1 is an open-weight model for text generation from Sam EnMin Huang, released under other. It has 3.1B parameters and a 32,768-token context. At 16-bit it needs about 7.4 GB of GPU memory, which fits on 1x MI300X from $1.85 an hour, at the lowest prices in the SAVRN Index. It draws 193 downloads a month.

Files: merged bf16 safetensors + tokenizer + chat template (final LoRA adapter merged into grpo-v2). Load with plain AutoModelForCausalLM; saved with transformers 5.x (dtype key, chattemplate.jinja).

Parameters3.1B
Context32,768
Weights6.2 GB
Licenseother
AccessOpen weights
Monthly Downloads193

Runs On

What it takes to serve Qwen2.5-3B-Instruct-Sheldon-RLVR-math-v1 (3.1B parameters): the memory its weights need at each precision, and the cheapest way to rent enough data-center GPUs to hold them.

PrecisionWeightsMemory neededCheapest setupPer hourAlso fits
16-bit 6.2 GB 7.4 GB 1x MI300X (192 GB)
Vultr
$1.85 1x H100 $1.99 · 1x MI325X $2.00
8-bit 3.1 GB 3.7 GB 1x MI300X (192 GB)
Vultr
$1.85 1x H100 $1.99 · 1x MI325X $2.00
4-bit 1.5 GB 1.9 GB 1x MI300X (192 GB)
Vultr
$1.85 1x H100 $1.99 · 1x MI325X $2.00

Memory is the weights at that precision plus 20% for the runtime and a short context; a long context needs more. Prices are the lowest on-demand hourly rates in the SAVRN Index, read Oct 18, 2026.

Qwen2.5-3B-Instruct-Sheldon-RLVR-math-v1 on every accelerator the SAVRN Index prices, at every precision

Model Card

Files: merged bf16 safetensors + tokenizer + chat template (final LoRA adapter merged into grpo-v2). Load with plain AutoModelForCausalLM; saved with transformers 5.x (dtype key, chattemplate.jinja). Companion repo with the adapter and checkpoints: tbooy/Qwen2.5-3B-Instruct-Sheldon-RLVR-math-v1-LoRA. Stage-3 (RLVR) model of a Harvard CS 2881R project: reinforcement learning with a verifiable math reward on top of tbooy/Qwen2.5-3B-Instruct-Sheldon-RLAIF-grpo-v2 (SFT persona model -> RLAIF GRPO -> this), the persona being Dr. Sheldon Cooper. Why this stage exists: the persona SFT stage cost most of Qwen2.5-3B-Instruct's competition-math ability (MATH-500 greedy 68.0 -> 35.4), and the RLAIF…

Excerpt from the card by Sam EnMin Huang, licensed other.

Configuration

Architecture
Qwen2ForCausalLM
Context length (tokens)
32,768
Layers
36
Hidden size
2,048
Feed-forward size
11,008
Attention heads
16
Key/value heads
2
Vocabulary size
151,936
Model type
qwen2

Identity and Version

Repository
tbooy/Qwen2.5-3B-Instruct-Sheldon-RLVR-math-v1
Publisher
Sam EnMin Huang
Task
Text generation
Modality
Text
Library
transformers
Parameters
3.1B parameters
Languages
en
Revision
a27dc99fff493cc7fdfa0c0610c6bcc55dd62c56
First published
2026-09-26
Last updated
2026-09-27

Files and Weights

8 files, 6.2 GB in total. The weights are 1 file totalling 6.2 GB in safetensors.

Weights1 file · 6.2 GB
Configuration2 files · 1.8 KB
Tokenizer2 files · 11.4 MB
Documentation1 file · 3.9 KB
Other1 file · 2.5 KB
Repository1 file · 1.6 KB
Every file
FileTypeSizeSHA-256
model.safetensorsWeights6.2 GB 9de0f2024885
config.jsonConfiguration1.6 KB —
generation_config.jsonConfiguration217 B —
README.mdDocumentation3.9 KB —
chat_template.jinjaOther2.5 KB —
.gitattributesRepository1.6 KB —
tokenizer.jsonTokenizer11.4 MB 3fd169731d2c
tokenizer_config.jsonTokenizer693 B —

License and Download

License
other
Access
Open weights, no gate
Download size
6.2 GB
Download from Sam EnMin Huang

Released by Sam EnMin Huang through its official repository on Hugging Face. Read the license.

Built From

Memory Requirements

PrecisionWeights in memory
As published6.2 GB
16-bit6.2 GB
8-bit3.1 GB
4-bit1.5 GB

Weights only, from the published parameter count; the key-value cache and runtime add to this.

Built on This Model

Questions About Qwen2.5-3B-Instruct-Sheldon-RLVR-math-v1

How much GPU memory does Qwen2.5-3B-Instruct-Sheldon-RLVR-math-v1 need?

About 7.4 GB at 16-bit and 1.9 GB at 4-bit: the weights (3.1B parameters) plus a working margin. A long context needs more.

What is the cheapest GPU to run Qwen2.5-3B-Instruct-Sheldon-RLVR-math-v1 on?

At 16-bit, 1x MI300X from $1.85 an hour; at 4-bit, 1x MI300X from $1.85 an hour, at the lowest on-demand prices the SAVRN Index lists.

What license is Qwen2.5-3B-Instruct-Sheldon-RLVR-math-v1 released under?

other, as its publisher declares it. Read the license text before commercial use.

What is Qwen2.5-3B-Instruct-Sheldon-RLVR-math-v1's context length?

32,768 tokens, from the maximum position embeddings in its published configuration.

Similar Models

Model · Text generation

Qwen2.5-3B-Instruct

Qwen

Qwen2.5 is the latest series of Qwen large language models. For Qwen2.5, we release a number of base language models and instruction-tuned language models ranging from 0.5 to 72 billion parameters. Qwen2.5 brings the following improvements upon Qwen2: - Significantly more knowledge and has greatly improved capabilities in coding and mathematics, thanks to our specialized expert models in these domains. - Significant improvements in instruction following, generating long texts (over 8K tokens), understanding structured data (e.g, tables), and generating structured outputs especially JSON. More resilient to the diversity of system prompts, enhancing role-play implementation and…

Open weights other 3.1B parameters 32,768 tokens transformers

Model · Text generation

Kartik-Kundli-AI-3B-v2.0

Kartik Sharma

India's Own Vedic Astrology AI - Ab aapka Kundli Expert aapke laptop pe! Ye model Vedic Astrology, Kundli, Rashi, Nakshatra, Dasha pe specially fine-tune kiya gaya hai. 3B size ka hai isliye aapke laptop / mobile pe bhi tez chalega. - "Meri Mesh rashi ka aaj ka bhavishya kya hai?" - "Kundli me Mangal Dosh kya hota hai?" - "Mere janm nakshatra ka matlab kya hai?" - "Shani ki sade sati kab khatam hogi?" Ye model Medical, Legal ya Financial advice ke liye nahi hai. Ye sirf educational astrology purpose ke liye hai. from transformers import AutoModelForCausalLM, AutoTokenizer modelid = "UX4567/Kartik-Kundli-AI-3B-v2.0" tokenizer = AutoTokenizer.frompretrained(modelid) model =…

Open weights mit 3.1B parameters 32,768 tokens transformers

Model · Text generation

axeron-forge-9fe917b4

AXERON AI INC

This is a forge of pre-trained language models created using forgelm. This model was forged using the TIES forge method using Qwen/Qwen2.5-3B as a base. The following models were included in the forge: The following YAML configuration was used to produce this model

Open weights 3.1B parameters 32,768 tokens transformers

Model · Text generation

PrismaCoder-3B

Sandeep Thummala

PrismaCoder-3B is a Qwen2.5-Coder-3B-Instruct fine-tune specialized for generating and editing Prisma ORM schemas and client code from natural-language instructions. It was trained with a full SFT → DPO → GRPO pipeline, using a verifier (gate) as both the data-quality filter and the reinforcement-learning reward signal. stage, LoRA weights merged into the base model between stages iterative self-play RL round (attempted; see Limitations) weights for release All stages used seed 20260830 and ran on a single Kaggle T4 GPU (16GB) with gradient checkpointing and paged 8-bit AdamW. verifier (LightValidator, "V0" in the project's internal gate numbering): it checks that generated Prisma…

Open weights apache-2.0 3.1B parameters 32,768 tokens transformers

Stage-2 seed model of a Harvard CS 2881R project: Qwen/Qwen2.5-3B-Instruct fine-tuned to answer in the voice of Dr. Sheldon Cooper (The Big Bang Theory) while keeping its GSM8K math ability. This is the checkpoint-1 model v3b (agastyasridharan/Qwen2.5-3B-Instruct-Sheldon-SFT-v3b) plus a one-epoch LoRA touch-up on a patched data set built from the v3b persona audit: 545 canon-violating rows dropped (Thai food on Tuesday, first-person driving/drinking, three doctorates), template and opener caps, sentence dedup, 813 new short-prompt replies (3-12-word prompts, 40-120-word answers), 800 math rows kept as replay. Files: merged bf16 safetensors + tokenizer, loadable with…

Open weights other 3.1B parameters 32,768 tokens transformers

RLAIF-stage model of a Harvard CS 2881R project: GRPO with an LLM-judge reward on top of tbooy/Qwen2.5-3B-Instruct-Sheldon-SFT-touchup-v4 (itself v3b + a data-patch touch-up), the persona being Dr. Sheldon Cooper and the protected STEM task GSM8K. Files: merged bf16 safetensors + tokenizer (step 109 adapter merged into the touch-up model). Reward R = G (2 P + F) - rules - 0.5 falseclaim - batchtax: a persona-blind task gate G (asks satisfied, refusal, harm, self-contradiction, false claims about the user), a pairwise persona score P from sibling comparisons judged in both presentation orders on nine items, a small form bonus F, 17 deterministic rule penalties from the v3b audit (canon…

Open weights other 3.1B parameters 32,768 tokens transformers