Skip to page content
SAVRN
Search Plan a project

Open-weight model · Text generation

axeron-forge-9fe917b4

by AXERON AI INC AxeronAI/axeron-forge-9fe917b4

axeron-forge-9fe917b4 is an open-weight model for text generation from AXERON AI INC. It has 3.1B parameters and a 32,768-token context. At 16-bit it needs about 7.4 GB of GPU memory, which fits on 1x MI300X from $1.85 an hour, at the lowest prices in the SAVRN Index.

This is a forge of pre-trained language models created using forgelm. This model was forged using the TIES forge method using Qwen/Qwen2.5-3B as a base.

Parameters3.1B
Context32,768
Weights6.2 GB
License—
AccessOpen weights
Monthly Downloads—

Runs On

What it takes to serve axeron-forge-9fe917b4 (3.1B parameters): the memory its weights need at each precision, and the cheapest way to rent enough data-center GPUs to hold them.

PrecisionWeightsMemory neededCheapest setupPer hourAlso fits
16-bit 6.2 GB 7.4 GB 1x MI300X (192 GB)
Vultr
$1.85 1x H100 $1.99 · 1x MI325X $2.00
8-bit 3.1 GB 3.7 GB 1x MI300X (192 GB)
Vultr
$1.85 1x H100 $1.99 · 1x MI325X $2.00
4-bit 1.5 GB 1.9 GB 1x MI300X (192 GB)
Vultr
$1.85 1x H100 $1.99 · 1x MI325X $2.00

Memory is the weights at that precision plus 20% for the runtime and a short context; a long context needs more. Prices are the lowest on-demand hourly rates in the SAVRN Index, read Oct 18, 2026.

axeron-forge-9fe917b4 on every accelerator the SAVRN Index prices, at every precision

Model Card

This is a forge of pre-trained language models created using forgelm. This model was forged using the TIES forge method using Qwen/Qwen2.5-3B as a base. The following models were included in the forge: The following YAML configuration was used to produce this model

Excerpt from the card by AXERON AI INC.

Configuration

Architecture
Qwen2ForCausalLM
Context length (tokens)
32,768
Layers
36
Hidden size
2,048
Feed-forward size
11,008
Attention heads
16
Key/value heads
2
Vocabulary size
151,936
RoPE base
1e+06
Model type
qwen2

Identity and Version

Repository
AxeronAI/axeron-forge-9fe917b4
Publisher
AXERON AI INC
Task
Text generation
Modality
Text
Library
transformers
Parameters
3.1B parameters
Languages
Not stated by the source
Revision
47caa5ef1402e035d8b2523b7df556d59513f3bd
First published
2026-09-19
Last updated
2026-09-19

Files and Weights

10 files, 6.2 GB in total. The weights are 2 files totalling 6.2 GB in safetensors.

Weights2 files · 6.2 GB
Configuration4 files · 37.6 KB
Tokenizer2 files · 7.0 MB
Documentation1 file · 1.0 KB
Repository1 file · 1.5 KB
Every file
FileTypeSizeSHA-256
model-00001-of-00002.safetensorsWeights5.0 GB d5a235d9274e
model-00002-of-00002.safetensorsWeights1.2 GB b216903117c5
config.jsonConfiguration1.5 KB —
forgelm_config.ymlConfiguration309 B —
generation_config.jsonConfiguration138 B —
model.safetensors.index.jsonConfiguration35.6 KB —
README.mdDocumentation1.0 KB —
.gitattributesRepository1.5 KB —
tokenizer.jsonTokenizer7.0 MB —
tokenizer_config.jsonTokenizer7.2 KB —

License and Download

License
Not stated by the source
Access
Open weights, no gate
Download size
6.2 GB
Download from AXERON AI INC

Released by AXERON AI INC through its official repository on Hugging Face.

Built From

  • Derived from Qwen/Qwen2.5-3B
  • Described by arXiv:2306.01708

Memory Requirements

PrecisionWeights in memory
As published6.2 GB
16-bit6.2 GB
8-bit3.1 GB
4-bit1.5 GB

Weights only, from the published parameter count; the key-value cache and runtime add to this.

Questions About axeron-forge-9fe917b4

How much GPU memory does axeron-forge-9fe917b4 need?

About 7.4 GB at 16-bit and 1.9 GB at 4-bit: the weights (3.1B parameters) plus a working margin. A long context needs more.

What is the cheapest GPU to run axeron-forge-9fe917b4 on?

At 16-bit, 1x MI300X from $1.85 an hour; at 4-bit, 1x MI300X from $1.85 an hour, at the lowest on-demand prices the SAVRN Index lists.

What is axeron-forge-9fe917b4's context length?

32,768 tokens, from the maximum position embeddings in its published configuration.

Similar Models

Model · Text generation

Qwen2.5-3B-Instruct

Qwen

Qwen2.5 is the latest series of Qwen large language models. For Qwen2.5, we release a number of base language models and instruction-tuned language models ranging from 0.5 to 72 billion parameters. Qwen2.5 brings the following improvements upon Qwen2: - Significantly more knowledge and has greatly improved capabilities in coding and mathematics, thanks to our specialized expert models in these domains. - Significant improvements in instruction following, generating long texts (over 8K tokens), understanding structured data (e.g, tables), and generating structured outputs especially JSON. More resilient to the diversity of system prompts, enhancing role-play implementation and…

Open weights other 3.1B parameters 32,768 tokens transformers

Files: merged bf16 safetensors + tokenizer + chat template (final LoRA adapter merged into grpo-v2). Load with plain AutoModelForCausalLM; saved with transformers 5.x (dtype key, chattemplate.jinja). Companion repo with the adapter and checkpoints: tbooy/Qwen2.5-3B-Instruct-Sheldon-RLVR-math-v1-LoRA. Stage-3 (RLVR) model of a Harvard CS 2881R project: reinforcement learning with a verifiable math reward on top of tbooy/Qwen2.5-3B-Instruct-Sheldon-RLAIF-grpo-v2 (SFT persona model -> RLAIF GRPO -> this), the persona being Dr. Sheldon Cooper. Why this stage exists: the persona SFT stage cost most of Qwen2.5-3B-Instruct's competition-math ability (MATH-500 greedy 68.0 -> 35.4), and the RLAIF…

Open weights other 3.1B parameters 32,768 tokens transformers

Model · Text generation

Kartik-Kundli-AI-3B-v2.0

Kartik Sharma

India's Own Vedic Astrology AI - Ab aapka Kundli Expert aapke laptop pe! Ye model Vedic Astrology, Kundli, Rashi, Nakshatra, Dasha pe specially fine-tune kiya gaya hai. 3B size ka hai isliye aapke laptop / mobile pe bhi tez chalega. - "Meri Mesh rashi ka aaj ka bhavishya kya hai?" - "Kundli me Mangal Dosh kya hota hai?" - "Mere janm nakshatra ka matlab kya hai?" - "Shani ki sade sati kab khatam hogi?" Ye model Medical, Legal ya Financial advice ke liye nahi hai. Ye sirf educational astrology purpose ke liye hai. from transformers import AutoModelForCausalLM, AutoTokenizer modelid = "UX4567/Kartik-Kundli-AI-3B-v2.0" tokenizer = AutoTokenizer.frompretrained(modelid) model =…

Open weights mit 3.1B parameters 32,768 tokens transformers

Model · Text generation

PrismaCoder-3B

Sandeep Thummala

PrismaCoder-3B is a Qwen2.5-Coder-3B-Instruct fine-tune specialized for generating and editing Prisma ORM schemas and client code from natural-language instructions. It was trained with a full SFT → DPO → GRPO pipeline, using a verifier (gate) as both the data-quality filter and the reinforcement-learning reward signal. stage, LoRA weights merged into the base model between stages iterative self-play RL round (attempted; see Limitations) weights for release All stages used seed 20260830 and ran on a single Kaggle T4 GPU (16GB) with gradient checkpointing and paged 8-bit AdamW. verifier (LightValidator, "V0" in the project's internal gate numbering): it checks that generated Prisma…

Open weights apache-2.0 3.1B parameters 32,768 tokens transformers

Stage-2 seed model of a Harvard CS 2881R project: Qwen/Qwen2.5-3B-Instruct fine-tuned to answer in the voice of Dr. Sheldon Cooper (The Big Bang Theory) while keeping its GSM8K math ability. This is the checkpoint-1 model v3b (agastyasridharan/Qwen2.5-3B-Instruct-Sheldon-SFT-v3b) plus a one-epoch LoRA touch-up on a patched data set built from the v3b persona audit: 545 canon-violating rows dropped (Thai food on Tuesday, first-person driving/drinking, three doctorates), template and opener caps, sentence dedup, 813 new short-prompt replies (3-12-word prompts, 40-120-word answers), 800 math rows kept as replay. Files: merged bf16 safetensors + tokenizer, loadable with…

Open weights other 3.1B parameters 32,768 tokens transformers

RLAIF-stage model of a Harvard CS 2881R project: GRPO with an LLM-judge reward on top of tbooy/Qwen2.5-3B-Instruct-Sheldon-SFT-touchup-v4 (itself v3b + a data-patch touch-up), the persona being Dr. Sheldon Cooper and the protected STEM task GSM8K. Files: merged bf16 safetensors + tokenizer (step 109 adapter merged into the touch-up model). Reward R = G (2 P + F) - rules - 0.5 falseclaim - batchtax: a persona-blind task gate G (asks satisfied, refusal, harm, self-contradiction, false claims about the user), a pairwise persona score P from sibling comparisons judged in both presentation orders on nine items, a small form bonus F, 17 deterministic rule penalties from the v3b audit (canon…

Open weights other 3.1B parameters 32,768 tokens transformers