Skip to page content
SAVRN
Search Plan a project

Open-weight model · Text generation

axeron-mf-44

by AXERON AI INC AxeronAI/axeron-mf-44

axeron-mf-44 is an open-weight model for text generation from AXERON AI INC. It has 3.1B parameters and a 32,768-token context. At 16-bit it needs about 7.4 GB of GPU memory, which fits on 1x MI300X from $1.85 an hour, at the lowest prices in the SAVRN Index.

This is a forge of pre-trained language models created using forgelm. This model was forged using the SLERP forge method. The following models were included in the forge: The following YAML configuration was used to produce this model

Parameters3.1B
Context32,768
Weights6.2 GB
License—
AccessOpen weights
Monthly Downloads—

Runs On

What it takes to serve axeron-mf-44 (3.1B parameters): the memory its weights need at each precision, and the cheapest way to rent enough data-center GPUs to hold them.

PrecisionWeightsMemory neededCheapest setupPer hourAlso fits
16-bit 6.2 GB 7.4 GB 1x MI300X (192 GB)
Vultr
$1.85 1x H100 $1.99 · 1x MI325X $2.00
8-bit 3.1 GB 3.7 GB 1x MI300X (192 GB)
Vultr
$1.85 1x H100 $1.99 · 1x MI325X $2.00
4-bit 1.5 GB 1.9 GB 1x MI300X (192 GB)
Vultr
$1.85 1x H100 $1.99 · 1x MI325X $2.00

Memory is the weights at that precision plus 20% for the runtime and a short context; a long context needs more. Prices are the lowest on-demand hourly rates in the SAVRN Index, read Oct 18, 2026.

axeron-mf-44 on every accelerator the SAVRN Index prices, at every precision

Model Card

This is a forge of pre-trained language models created using forgelm. This model was forged using the SLERP forge method. The following models were included in the forge: The following YAML configuration was used to produce this model

Excerpt from the card by AXERON AI INC.

Configuration

Architecture
Qwen2ForCausalLM
Context length (tokens)
32,768
Layers
36
Hidden size
2,048
Feed-forward size
11,008
Attention heads
16
Key/value heads
2
Vocabulary size
151,665
RoPE base
1e+06
Model type
qwen2

Identity and Version

Repository
AxeronAI/axeron-mf-44
Publisher
AXERON AI INC
Task
Text generation
Modality
Text
Library
transformers
Parameters
3.1B parameters
Languages
Not stated by the source
Revision
a737e7b15033f4ffea4f3665a06275565fab92a2
First published
2026-09-19
Last updated
2026-09-19

Files and Weights

14 files, 6.2 GB in total. The weights are 2 files totalling 6.2 GB in safetensors.

Weights2 files · 6.2 GB
Configuration5 files · 38.6 KB
Tokenizer4 files · 15.9 MB
Documentation1 file · 958 B
Other1 file · 2.4 KB
Repository1 file · 1.6 KB
Every file
FileTypeSizeSHA-256
model-00001-of-00002.safetensorsWeights5.0 GB f9752abe6bec
model-00002-of-00002.safetensorsWeights1.2 GB af25c8181627
added_tokens.jsonConfiguration605 B —
config.jsonConfiguration1.5 KB —
forgelm_config.ymlConfiguration286 B —
model.safetensors.index.jsonConfiguration35.6 KB —
special_tokens_map.jsonConfiguration616 B —
README.mdDocumentation958 B —
chat_template.jinjaOther2.4 KB —
.gitattributesRepository1.6 KB —
merges.txtTokenizer1.7 MB —
tokenizer.jsonTokenizer11.4 MB 9c5ae00e602b
tokenizer_config.jsonTokenizer4.7 KB —
vocab.jsonTokenizer2.8 MB —

License and Download

License
Not stated by the source
Access
Open weights, no gate
Download size
6.2 GB
Download from AXERON AI INC

Released by AXERON AI INC through its official repository on Hugging Face.

Built From

  • Derived from Qwen/Qwen2.5-3B

Memory Requirements

PrecisionWeights in memory
As published6.2 GB
16-bit6.2 GB
8-bit3.1 GB
4-bit1.5 GB

Weights only, from the published parameter count; the key-value cache and runtime add to this.

Questions About axeron-mf-44

How much GPU memory does axeron-mf-44 need?

About 7.4 GB at 16-bit and 1.9 GB at 4-bit: the weights (3.1B parameters) plus a working margin. A long context needs more.

What is the cheapest GPU to run axeron-mf-44 on?

At 16-bit, 1x MI300X from $1.85 an hour; at 4-bit, 1x MI300X from $1.85 an hour, at the lowest on-demand prices the SAVRN Index lists.

What is axeron-mf-44's context length?

32,768 tokens, from the maximum position embeddings in its published configuration.

Similar Models

Model · Text generation

Qwen2.5-3B-Instruct

Qwen

Qwen2.5 is the latest series of Qwen large language models. For Qwen2.5, we release a number of base language models and instruction-tuned language models ranging from 0.5 to 72 billion parameters. Qwen2.5 brings the following improvements upon Qwen2: - Significantly more knowledge and has greatly improved capabilities in coding and mathematics, thanks to our specialized expert models in these domains. - Significant improvements in instruction following, generating long texts (over 8K tokens), understanding structured data (e.g, tables), and generating structured outputs especially JSON. More resilient to the diversity of system prompts, enhancing role-play implementation and…

Open weights other 3.1B parameters 32,768 tokens transformers

Files: merged bf16 safetensors + tokenizer + chat template (final LoRA adapter merged into grpo-v2). Load with plain AutoModelForCausalLM; saved with transformers 5.x (dtype key, chattemplate.jinja). Companion repo with the adapter and checkpoints: tbooy/Qwen2.5-3B-Instruct-Sheldon-RLVR-math-v1-LoRA. Stage-3 (RLVR) model of a Harvard CS 2881R project: reinforcement learning with a verifiable math reward on top of tbooy/Qwen2.5-3B-Instruct-Sheldon-RLAIF-grpo-v2 (SFT persona model -> RLAIF GRPO -> this), the persona being Dr. Sheldon Cooper. Why this stage exists: the persona SFT stage cost most of Qwen2.5-3B-Instruct's competition-math ability (MATH-500 greedy 68.0 -> 35.4), and the RLAIF…

Open weights other 3.1B parameters 32,768 tokens transformers

Model · Text generation

Kartik-Kundli-AI-3B-v2.0

Kartik Sharma

India's Own Vedic Astrology AI - Ab aapka Kundli Expert aapke laptop pe! Ye model Vedic Astrology, Kundli, Rashi, Nakshatra, Dasha pe specially fine-tune kiya gaya hai. 3B size ka hai isliye aapke laptop / mobile pe bhi tez chalega. - "Meri Mesh rashi ka aaj ka bhavishya kya hai?" - "Kundli me Mangal Dosh kya hota hai?" - "Mere janm nakshatra ka matlab kya hai?" - "Shani ki sade sati kab khatam hogi?" Ye model Medical, Legal ya Financial advice ke liye nahi hai. Ye sirf educational astrology purpose ke liye hai. from transformers import AutoModelForCausalLM, AutoTokenizer modelid = "UX4567/Kartik-Kundli-AI-3B-v2.0" tokenizer = AutoTokenizer.frompretrained(modelid) model =…

Open weights mit 3.1B parameters 32,768 tokens transformers

Model · Text generation

axeron-forge-9fe917b4

AXERON AI INC

This is a forge of pre-trained language models created using forgelm. This model was forged using the TIES forge method using Qwen/Qwen2.5-3B as a base. The following models were included in the forge: The following YAML configuration was used to produce this model

Open weights 3.1B parameters 32,768 tokens transformers

Model · Text generation

PrismaCoder-3B

Sandeep Thummala

PrismaCoder-3B is a Qwen2.5-Coder-3B-Instruct fine-tune specialized for generating and editing Prisma ORM schemas and client code from natural-language instructions. It was trained with a full SFT → DPO → GRPO pipeline, using a verifier (gate) as both the data-quality filter and the reinforcement-learning reward signal. stage, LoRA weights merged into the base model between stages iterative self-play RL round (attempted; see Limitations) weights for release All stages used seed 20260830 and ran on a single Kaggle T4 GPU (16GB) with gradient checkpointing and paged 8-bit AdamW. verifier (LightValidator, "V0" in the project's internal gate numbering): it checks that generated Prisma…

Open weights apache-2.0 3.1B parameters 32,768 tokens transformers

Stage-2 seed model of a Harvard CS 2881R project: Qwen/Qwen2.5-3B-Instruct fine-tuned to answer in the voice of Dr. Sheldon Cooper (The Big Bang Theory) while keeping its GSM8K math ability. This is the checkpoint-1 model v3b (agastyasridharan/Qwen2.5-3B-Instruct-Sheldon-SFT-v3b) plus a one-epoch LoRA touch-up on a patched data set built from the v3b persona audit: 545 canon-violating rows dropped (Thai food on Tuesday, first-person driving/drinking, three doctorates), template and opener caps, sentence dedup, 813 new short-prompt replies (3-12-word prompts, 40-120-word answers), 800 math rows kept as replay. Files: merged bf16 safetensors + tokenizer, loadable with…

Open weights other 3.1B parameters 32,768 tokens transformers