SAVRN
Search Contact SAVRN

Open-weight model · Text generation

Shreyansh-STEM-AI-2B-v3

by Shreyansh singh shreyansh12183/Shreyansh-STEM-AI-2B-v3

Shreyansh-STEM-AI-2B-v3 is an open-weight model for text generation from Shreyansh singh, released under Creative Commons Attribution-NonCommercial 4.0. It has 1.9B parameters and a 4,096-token context. At 16-bit it needs about 4.5 GB of GPU memory, which fits on 1x MI300X from $1.85 an hour, at the lowest prices in the SAVRN Index. It draws 156 downloads a month.

Shreyansh-STEM-AI-2B-v3 is a sovereign compact foundation model for scientific, physical, and mathematical derivation, engineered through SOLAR-style Depth Up-Scaling (DUS) and Continual Pre-Training (CPT) Seam Healing.

Parameters1.9B
Context4,096
Weights3.8 GB
Licensecc-by-nc-4.0
AccessOpen weights
Monthly Downloads156

Runs On

What it takes to serve Shreyansh-STEM-AI-2B-v3 (1.9B parameters): the memory its weights need at each precision, and the cheapest way to rent enough data-center GPUs to hold them.

PrecisionWeightsMemory neededCheapest setupPer hourAlso fits
16-bit 3.8 GB 4.5 GB 1x MI300X (192 GB)
Vultr
$1.85 1x H100 $1.99 · 1x MI325X $2.00
8-bit 1.9 GB 2.3 GB 1x MI300X (192 GB)
Vultr
$1.85 1x H100 $1.99 · 1x MI325X $2.00
4-bit 0.9 GB 1.1 GB 1x MI300X (192 GB)
Vultr
$1.85 1x H100 $1.99 · 1x MI325X $2.00

Memory is the weights at that precision plus 20% for the runtime and a short context; a long context needs more. Prices are the lowest on-demand hourly rates in the SAVRN Index, read Oct 7, 2026.

Shreyansh-STEM-AI-2B-v3 on every accelerator the SAVRN Index prices, at every precision

Model Card

Shreyansh-STEM-AI-2B-v3 is a sovereign compact foundation model for scientific, physical, and mathematical derivation, engineered through SOLAR-style Depth Up-Scaling (DUS) and Continual Pre-Training (CPT) Seam Healing. To surpass standard 2B parameter capacity without requiring training from scratch, intermediate transformer layers were duplicated and spliced, expanding the model depth to 22 layers with a hidden dimension of $d=2048$. Splicing transformer blocks introduces interface discontinuity along the residual stream. To heal these seams, the model underwent Continual Pre-Training (CPT) over the multi-gigabyte shreyansh-1B-SLM-pretrain-stem-english corpus (over 2,400 parquet shards).…

Excerpt from the card by Shreyansh singh, licensed cc-by-nc-4.0.

Configuration

Architecture
Olmo2ForCausalLM
Context length (tokens)
4,096
Layers
22
Hidden size
2,048
Feed-forward size
8,192
Attention heads
16
Key/value heads
16
Vocabulary size
100,352
Model type
olmo2

Identity and Version

Repository
shreyansh12183/Shreyansh-STEM-AI-2B-v3
Publisher
Shreyansh singh
Task
Text generation
Modality
Text
Library
Not stated by the source
Parameters
1.9B parameters
Languages
dus, cpt-healing
Revision
c0d1e630941d0c225a2f7fec69fda27fdcde0b90
First published
2026-09-19
Last updated
2026-10-06

Files and Weights

7 files, 3.8 GB in total. The weights are 1 file totalling 3.8 GB in safetensors.

Weights1 file · 3.8 GB
Configuration2 files · 816 B
Tokenizer2 files · 7.1 MB
Documentation1 file · 4.5 KB
Repository1 file · 1.5 KB
Every file
FileTypeSizeSHA-256
model.safetensorsWeights3.8 GB d69ecf4bfc2f
config.jsonConfiguration674 B —
generation_config.jsonConfiguration142 B —
README.mdDocumentation4.5 KB —
.gitattributesRepository1.5 KB —
tokenizer.jsonTokenizer7.1 MB —
tokenizer_config.jsonTokenizer396 B —

License and Download

License
cc-by-nc-4.0
Access
Open weights, no gate
Download size
3.8 GB
Download from Shreyansh singh

Released by Shreyansh singh through its official repository on Hugging Face. Read the license.

Memory Requirements

PrecisionWeights in memory
As published3.8 GB
16-bit3.8 GB
8-bit1.9 GB
4-bit0.9 GB

Weights only, from the published parameter count; the key-value cache and runtime add to this.

Built on This Model

Questions About Shreyansh-STEM-AI-2B-v3

How much GPU memory does Shreyansh-STEM-AI-2B-v3 need?

About 4.5 GB at 16-bit and 1.1 GB at 4-bit: the weights (1.9B parameters) plus a working margin. A long context needs more.

What is the cheapest GPU to run Shreyansh-STEM-AI-2B-v3 on?

At 16-bit, 1x MI300X from $1.85 an hour; at 4-bit, 1x MI300X from $1.85 an hour, at the lowest on-demand prices the SAVRN Index lists.

Can I use Shreyansh-STEM-AI-2B-v3 commercially?

Not without separate permission. Shreyansh-STEM-AI-2B-v3 is released under Creative Commons Attribution-NonCommercial 4.0. CC BY-NC 4.0 permits sharing and adapting with credit for non-commercial purposes only. Commercial use needs separate permission from the rights holder.

What is Shreyansh-STEM-AI-2B-v3's context length?

4,096 tokens, from the maximum position embeddings in its published configuration.

Similar Models

Website: jevstyle.com — all JevStyle decision models, benchmarks and quickstart in one place. A Jev-style decision model: it does not write text. Give it a state, a question and a list of options, and one forward pass returns the decision with calibrated probabilities - in 77 ms on an M1 Max. GGUF builds (BF16 / Q80 / Q4KM) for LM Studio and llama.cpp: chaoliangUNSW/Jev-Style-Qwen3.5-2B-Decision-GGUF Everything below is measured on data the model never trained on, with the probabilities exactly as the released weights produce them (no post-processing). - Calibrated out of the box. An ECE of 0.017 on 1,500 examples is statistically indistinguishable from a perfectly calibrated model…

Open weights apache-2.0 1.9B parameters 262,144 tokens mlx

Website: jevstyle.com — all JevStyle decision models, benchmarks and quickstart in one place. A Jev-style decision model for classification, routing and typed choices. Give it a state, a question and a list of options; one prefill returns a selected option with calibrated probabilities. Download this build: model.safetensors. The repository also includes its calibration, inference client and evaluation records. 81.20% macro accuracy on the fixed English reference panel, compared with 76.68% for v1 and 75.09% for English Laya. The results below use the CUDA reference structure: 11 real-label task groups, 3,277 decisions, equal task weights, and the same 3,100-record calibration split.…

Open weights apache-2.0 1.9B parameters 262,144 tokens mlx

Website: jevstyle.com — all JevStyle decision models, benchmarks and quickstart in one place. A Jev-style decision model for classification, routing and typed choices. Give it a state, a question and a list of options; one prefill returns a selected option with calibrated probabilities. Download this build: model.safetensors. The repository also includes its calibration, inference client and evaluation records. 81.20% macro accuracy on the fixed English reference panel, compared with 76.68% for v1 and 75.09% for English Laya. The results below use the CUDA reference structure: 11 real-label task groups, 3,277 decisions, equal task weights, and the same 3,100-record calibration split.…

Open weights apache-2.0 1.9B parameters 262,144 tokens transformers

Model · Text generation

dQwen3.5-2B-Base

IFML

A masked diffusion language model adapted from Qwen3.5-2B. The backbone is hybrid: only its attention layers are made bidirectional, and the Gated DeltaNet layers stay causal. This is a base model, with no instruction tuning. Paper: dQwen3.5: Hybrid-Attention Diffusion Language Models. Code: https://github.com/AntonXue/dQwen Needs a CUDA GPU and transformers>=5.13 (tested with torch 2.7.1+cu128, flash-linear-attention 0.5.1). generate decodes the whole canvas at once, committing positions above a confidence threshold (tau=0.9); pass blocklength=32 for left-to-right block decoding, or tau=None, stepsperblock=k for a fixed budget. The 50B-token checkpoint from the paper is…

Open weights apache-2.0 1.9B parameters 262,144 tokens transformers

VNPen is MewBaka Studio's visual-novel model series. The writer edition is for script writing, de-AI rewriting, and generating example scenes from a mood brief. Output format is one script line per line: speaker:text, with narration written as 旁白:. The base Qwen/Qwen3.5-2B is multimodal. Its checkpoint carries 297 model.visual. tensors (a depth-24 / hidden-1024 / patch-16 ViT) and 15 mtp. tensors for multi-token prediction. This project is text-only. In transformers, AutoModelForCausalLM on a qwen35 config builds Qwen35ForCausalLM over a Qwen35TextConfig — so the vision weights were never loaded at any point: not for training, not for merging, not for saving. Verified on the published…

Open weights apache-2.0 1.9B parameters 262,144 tokens transformers

Model · Text generation

ThinkLess-2B-FP8

Sadikh Shaik

FP8 version of ThinkLess-2B: 8-bit floating-point weights and activations, 2.5 GB (bf16: 4.3 GB), with near-identical accuracy. Made with llm-compressor (FP8DYNAMIC: per-channel FP8 weights, dynamic per-token FP8 activations, no calibration data). The output head, vision tower and MTP heads stay in 16-bit. The differences are within the 95% confidence intervals, and answers stay just as short (cut-offs ≤ 1%). FP8 compute needs a GPU with FP8 support (NVIDIA Hopper or Ada, e.g. H100, L4, RTX 40-series); vLLM loads the compressed-tensors format directly. Use Qwen3.5's thinking-mode sampling (temperature 1.0, top-p 0.95, top-k 20, presence penalty 1.5). A 4-bit AWQ version of ThinkLess-2B was…

Open weights apache-2.0 1.9B parameters 262,144 tokens transformers