Skip to page content
SAVRN
Search Plan a project

Open-weight model · Text generation

Qwen2.5-3B-Instruct-Sheldon-RLVR-math-v2-fullft

by Sam EnMin Huang tbooy/Qwen2.5-3B-Instruct-Sheldon-RLVR-math-v2-fullft

Qwen2.5-3B-Instruct-Sheldon-RLVR-math-v2-fullft is an open-weight model for text generation from Sam EnMin Huang, released under other. It has 3.1B parameters and a 32,768-token context. At 16-bit it needs about 7.4 GB of GPU memory, which fits on 1x MI300X from $1.85 an hour, at the lowest prices in the SAVRN Index.

Files: bf16 safetensors + tokenizer + chat template. Load with plain AutoModelForCausalLM; saved with transformers 5.x (dtype key, chattemplate.jinja). Stage-3c model of a Harvard CS 2881R project (persona: Dr.

Parameters3.1B
Context32,768
Weights6.2 GB
Licenseother
AccessOpen weights
Monthly Downloads—

Runs On

What it takes to serve Qwen2.5-3B-Instruct-Sheldon-RLVR-math-v2-fullft (3.1B parameters): the memory its weights need at each precision, and the cheapest way to rent enough data-center GPUs to hold them.

PrecisionWeightsMemory neededCheapest setupPer hourAlso fits
16-bit 6.2 GB 7.4 GB 1x MI300X (192 GB)
Vultr
$1.85 1x H100 $1.99 · 1x MI325X $2.00
8-bit 3.1 GB 3.7 GB 1x MI300X (192 GB)
Vultr
$1.85 1x H100 $1.99 · 1x MI325X $2.00
4-bit 1.5 GB 1.9 GB 1x MI300X (192 GB)
Vultr
$1.85 1x H100 $1.99 · 1x MI325X $2.00

Memory is the weights at that precision plus 20% for the runtime and a short context; a long context needs more. Prices are the lowest on-demand hourly rates in the SAVRN Index, read Oct 18, 2026.

Qwen2.5-3B-Instruct-Sheldon-RLVR-math-v2-fullft on every accelerator the SAVRN Index prices, at every precision

Model Card

Files: bf16 safetensors + tokenizer + chat template. Load with plain AutoModelForCausalLM; saved with transformers 5.x (dtype key, chattemplate.jinja). Stage-3c model of a Harvard CS 2881R project (persona: Dr. Sheldon Cooper): a full-parameter RLVR continuation of tbooy/Qwen2.5-3B-Instruct-Sheldon-RLVR-math-v1 (Qwen2.5-3B-Instruct -> persona SFT -> RLAIF -> LoRA RLVR v1 -> this). Why this model exists: after the v1 LoRA run plateaued (MATH-500 levels 3-5 at ~55 while about half the prompt groups had become all-correct), two LoRA continuations with a re-labelled, pool-expanded difficulty schedule stayed flat, so the last attempt on this seed trained all parameters instead: AdamW lr 2e-6…

Excerpt from the card by Sam EnMin Huang, licensed other.

Configuration

Architecture
Qwen2ForCausalLM
Context length (tokens)
32,768
Layers
36
Hidden size
2,048
Feed-forward size
11,008
Attention heads
16
Key/value heads
2
Vocabulary size
151,936
Model type
qwen2

Identity and Version

Repository
tbooy/Qwen2.5-3B-Instruct-Sheldon-RLVR-math-v2-fullft
Publisher
Sam EnMin Huang
Task
Text generation
Modality
Text
Library
transformers
Parameters
3.1B parameters
Languages
en
Revision
332ea6417af96eadb795cf351ab0208560c5e539
First published
2026-09-27
Last updated
2026-09-27

Files and Weights

8 files, 6.2 GB in total. The weights are 1 file totalling 6.2 GB in safetensors.

Weights1 file · 6.2 GB
Configuration2 files · 1.8 KB
Tokenizer2 files · 11.4 MB
Documentation1 file · 4.1 KB
Other1 file · 2.5 KB
Repository1 file · 1.6 KB
Every file
FileTypeSizeSHA-256
model.safetensorsWeights6.2 GB 07cfedf7ea37
config.jsonConfiguration1.6 KB —
generation_config.jsonConfiguration217 B —
README.mdDocumentation4.1 KB —
chat_template.jinjaOther2.5 KB —
.gitattributesRepository1.6 KB —
tokenizer.jsonTokenizer11.4 MB 3fd169731d2c
tokenizer_config.jsonTokenizer693 B —

License and Download

License
other
Access
Open weights, no gate
Download size
6.2 GB
Download from Sam EnMin Huang

Released by Sam EnMin Huang through its official repository on Hugging Face. Read the license.

Built From

Memory Requirements

PrecisionWeights in memory
As published6.2 GB
16-bit6.2 GB
8-bit3.1 GB
4-bit1.5 GB

Weights only, from the published parameter count; the key-value cache and runtime add to this.

Questions About Qwen2.5-3B-Instruct-Sheldon-RLVR-math-v2-fullft

How much GPU memory does Qwen2.5-3B-Instruct-Sheldon-RLVR-math-v2-fullft need?

About 7.4 GB at 16-bit and 1.9 GB at 4-bit: the weights (3.1B parameters) plus a working margin. A long context needs more.

What is the cheapest GPU to run Qwen2.5-3B-Instruct-Sheldon-RLVR-math-v2-fullft on?

At 16-bit, 1x MI300X from $1.85 an hour; at 4-bit, 1x MI300X from $1.85 an hour, at the lowest on-demand prices the SAVRN Index lists.

What license is Qwen2.5-3B-Instruct-Sheldon-RLVR-math-v2-fullft released under?

other, as its publisher declares it. Read the license text before commercial use.

What is Qwen2.5-3B-Instruct-Sheldon-RLVR-math-v2-fullft's context length?

32,768 tokens, from the maximum position embeddings in its published configuration.

Similar Models

Model · Text generation

Qwen2.5-3B-Instruct

Qwen

Qwen2.5 is the latest series of Qwen large language models. For Qwen2.5, we release a number of base language models and instruction-tuned language models ranging from 0.5 to 72 billion parameters. Qwen2.5 brings the following improvements upon Qwen2: - Significantly more knowledge and has greatly improved capabilities in coding and mathematics, thanks to our specialized expert models in these domains. - Significant improvements in instruction following, generating long texts (over 8K tokens), understanding structured data (e.g, tables), and generating structured outputs especially JSON. More resilient to the diversity of system prompts, enhancing role-play implementation and…

Open weights other 3.1B parameters 32,768 tokens transformers

Files: merged bf16 safetensors + tokenizer + chat template (final LoRA adapter merged into grpo-v2). Load with plain AutoModelForCausalLM; saved with transformers 5.x (dtype key, chattemplate.jinja). Companion repo with the adapter and checkpoints: tbooy/Qwen2.5-3B-Instruct-Sheldon-RLVR-math-v1-LoRA. Stage-3 (RLVR) model of a Harvard CS 2881R project: reinforcement learning with a verifiable math reward on top of tbooy/Qwen2.5-3B-Instruct-Sheldon-RLAIF-grpo-v2 (SFT persona model -> RLAIF GRPO -> this), the persona being Dr. Sheldon Cooper. Why this stage exists: the persona SFT stage cost most of Qwen2.5-3B-Instruct's competition-math ability (MATH-500 greedy 68.0 -> 35.4), and the RLAIF…

Open weights other 3.1B parameters 32,768 tokens transformers

Model · Text generation

Kartik-Kundli-AI-3B-v2.0

Kartik Sharma

India's Own Vedic Astrology AI - Ab aapka Kundli Expert aapke laptop pe! Ye model Vedic Astrology, Kundli, Rashi, Nakshatra, Dasha pe specially fine-tune kiya gaya hai. 3B size ka hai isliye aapke laptop / mobile pe bhi tez chalega. - "Meri Mesh rashi ka aaj ka bhavishya kya hai?" - "Kundli me Mangal Dosh kya hota hai?" - "Mere janm nakshatra ka matlab kya hai?" - "Shani ki sade sati kab khatam hogi?" Ye model Medical, Legal ya Financial advice ke liye nahi hai. Ye sirf educational astrology purpose ke liye hai. from transformers import AutoModelForCausalLM, AutoTokenizer modelid = "UX4567/Kartik-Kundli-AI-3B-v2.0" tokenizer = AutoTokenizer.frompretrained(modelid) model =…

Open weights mit 3.1B parameters 32,768 tokens transformers

Model · Text generation

axeron-forge-9fe917b4

AXERON AI INC

This is a forge of pre-trained language models created using forgelm. This model was forged using the TIES forge method using Qwen/Qwen2.5-3B as a base. The following models were included in the forge: The following YAML configuration was used to produce this model

Open weights 3.1B parameters 32,768 tokens transformers

Model · Text generation

PrismaCoder-3B

Sandeep Thummala

PrismaCoder-3B is a Qwen2.5-Coder-3B-Instruct fine-tune specialized for generating and editing Prisma ORM schemas and client code from natural-language instructions. It was trained with a full SFT → DPO → GRPO pipeline, using a verifier (gate) as both the data-quality filter and the reinforcement-learning reward signal. stage, LoRA weights merged into the base model between stages iterative self-play RL round (attempted; see Limitations) weights for release All stages used seed 20260830 and ran on a single Kaggle T4 GPU (16GB) with gradient checkpointing and paged 8-bit AdamW. verifier (LightValidator, "V0" in the project's internal gate numbering): it checks that generated Prisma…

Open weights apache-2.0 3.1B parameters 32,768 tokens transformers

Stage-2 seed model of a Harvard CS 2881R project: Qwen/Qwen2.5-3B-Instruct fine-tuned to answer in the voice of Dr. Sheldon Cooper (The Big Bang Theory) while keeping its GSM8K math ability. This is the checkpoint-1 model v3b (agastyasridharan/Qwen2.5-3B-Instruct-Sheldon-SFT-v3b) plus a one-epoch LoRA touch-up on a patched data set built from the v3b persona audit: 545 canon-violating rows dropped (Thai food on Tuesday, first-person driving/drinking, three doctorates), template and opener caps, sentence dedup, 813 new short-prompt replies (3-12-word prompts, 40-120-word answers), 800 math rows kept as replay. Files: merged bf16 safetensors + tokenizer, loadable with…

Open weights other 3.1B parameters 32,768 tokens transformers