SAVRN
Search Contact SAVRN

Open-weight model · Image and text to text

Rax-4.5

by RaxCore raxcore-dev/Rax-4.5

Over recent months, we have intensified our focus on developing foundation models that deliver exceptional utility and performance.

Parameters2.3B
Context262,144
Weights4.5 GB
Licenseapache-2.0
AccessOpen weights
Monthly Downloads952.2k

Runs On

What it takes to serve Rax-4.5 (2.3B parameters): the memory its weights need at each precision, and the cheapest way to rent enough data-center GPUs to hold them.

PrecisionWeightsMemory neededCheapest setupPer hourAlso fits
16-bit 4.5 GB 5.5 GB 1x MI300X (192 GB)
Vultr
$1.85 1x H100 $1.99 · 1x MI325X $2.00
8-bit 2.3 GB 2.7 GB 1x MI300X (192 GB)
Vultr
$1.85 1x H100 $1.99 · 1x MI325X $2.00
4-bit 1.1 GB 1.4 GB 1x MI300X (192 GB)
Vultr
$1.85 1x H100 $1.99 · 1x MI325X $2.00

Memory is the weights at that precision plus 20% for the runtime and a short context; a long context needs more. Prices are the lowest on-demand hourly rates in the SAVRN Index, read Sep 18, 2026.

SAVRN's Notes on Rax-4.5

A context window of 262,144 tokens on 2.3 billion parameters, taking image and text in and producing text. At 16-bit the weights are 4.5 GB and the run needs 5.5 GB of memory; 8-bit brings that to 2.7 GB and 4-bit to 1.4 GB. Any of those fits on the cheapest card in our table, one MI300X with 192 GB at $1.85 an hour on demand, and the spare room matters: a filled context window adds memory on top of the weights.

RaxCore publishes it under Apache 2.0, so commercial use, modification and redistribution are allowed with the notices retained. The architecture is listed as Qwen3_5ForConditionalGeneration, yet the only relation on record points back to Rax-4.5 itself, so ask the publisher what base model and data sit underneath. No SAVRN Index host serves it by the token yet, so self-hosting is the only price we can quote. Released November 27, 2025 and last updated July 13, 2026.

Model Card

By RaxCore, published under apache-2.0, revision 6ab58f792f61.

[!Note] This repository contains model weights and configuration files for the post-trained model in the Hugging Face Transformers format.

These artifacts are compatible with Hugging Face Transformers, vLLM, SGLang, KTransformers, etc.

In light of its parameter scale, the intended use cases are prototyping, task-specific fine-tuning, and other research or development purposes.

Over recent months, we have intensified our focus on developing foundation models that deliver exceptional utility and performance. Rax 4.5 represents a significant leap forward, integrating breakthroughs in multimodal learning, architectural efficiency, reinforcement learning scale, and global accessibility to empower developers and enterprises with unprecedented capability and efficiency.

Rax 4.5 Highlights

Rax 4.5 features the following enhancement:

Read the full model card (2,851 words)

Configuration

Architecture
Qwen3_5ForConditionalGeneration
Context length (tokens)
262,144
Layers
24
Hidden size
2,048
Feed-forward size
6,144
Attention heads
8
Key/value heads
2
Head dimension
256
Vocabulary size
248,320
Model type
qwen3_5

Identity and Version

Repository
raxcore-dev/Rax-4.5
Publisher
RaxCore
Task
Image and text to text
Modality
Image and text
Library
transformers
Parameters
2.3B parameters
Languages
Not stated by the source
Revision
6ab58f792f61e6fd144c6335ef87507c5b88bb0d
First published
2025-11-27
Last updated
2026-07-13

Files and Weights

13 files, 4.6 GB in total. The weights are 1 file totalling 4.5 GB in safetensors.

Weights1 file · 4.5 GB
Configuration4 files · 68.1 KB
Tokenizer4 files · 22.9 MB
Documentation2 files · 74.2 KB
Other1 file · 7.8 KB
Repository1 file · 1.6 KB
Every file
FileTypeSizeSHA-256
model.safetensors-00001-of-00001.safetensorsWeights4.5 GB aa33250c4fc6
config.jsonConfiguration2.9 KB
model.safetensors.index.jsonConfiguration64.5 KB
preprocessor_config.jsonConfiguration390 B
video_preprocessor_config.jsonConfiguration385 B
LICENSEDocumentation11.5 KB
README.mdDocumentation62.7 KB
chat_template.jinjaOther7.8 KB
.gitattributesRepository1.6 KB
merges.txtTokenizer3.4 MB
tokenizer.jsonTokenizer12.8 MB 5f9e4d4901a9
tokenizer_config.jsonTokenizer16.7 KB
vocab.jsonTokenizer6.7 MB

License and Download

License
apache-2.0
Access
Open weights, no gate
Download size
4.5 GB
Download from RaxCore

Released by RaxCore through its official repository on Hugging Face. Read the license.

Built From

Memory Requirements

PrecisionWeights in memory
As published4.5 GB
16-bit4.5 GB
8-bit2.3 GB
4-bit1.1 GB

Weights only, from the published parameter count; the key-value cache and runtime add to this.

Built on This Model

Compare Rax-4.5

Questions About Rax-4.5

How much GPU memory does Rax-4.5 need?

About 5.5 GB at 16-bit and 1.4 GB at 4-bit: the weights (2.3B parameters) plus a working margin. A long context needs more.

What is the cheapest GPU to run Rax-4.5 on?

At 16-bit, 1x MI300X from $1.85 an hour; at 4-bit, 1x MI300X from $1.85 an hour, at the lowest on-demand prices the SAVRN Index lists.

Can I use Rax-4.5 commercially?

Yes. Rax-4.5 is released under Apache License 2.0. The Apache License 2.0 is a permissive open-source license. It permits commercial use, modification and redistribution. It requires keeping the license and copyright notices and any NOTICE file, stating significant changes, and it includes an express patent grant from contributors.

What is Rax-4.5's context length?

262,144 tokens, from the maximum position embeddings in its published configuration.

Similar Models

Model · Image and text to text

Qwen3.5-2B

Qwen

Over recent months, we have intensified our focus on developing foundation models that deliver exceptional utility and performance. Qwen3.5 represents a significant leap forward, integrating breakthroughs in multimodal learning, architectural efficiency, reinforcement learning scale, and global accessibility to empower developers and enterprises with unprecedented capability and efficiency. For more details, please refer to our blog post Qwen3.5. WMT24++: a harder subset of WMT24 after difficulty labeling and rebalancing; we report the averaged scores on 55 languages using XCOMET-XXL. Empty cells (--) indicate scores not yet available or not applicable. Scores of Qwen3.5 models are reported…

Open weights apache-2.0 2.3B parameters 262,144 tokens transformers

Model · Image and text to text

Qwen3.5-2B-auto-optimized

Islam Assanov

This is Qwen3.5-2B auto-optimized by Claude Fable for fast single-request text generation. Fable built and tuned the included qwen35fast inference engine while keeping Qwen's original BF16 weights unchanged. Across 12 development workloads, the Fable engine delivered 14× the decode speed of Transformers eager and 1.02× the speed of vLLM with MTP (geometric means). On 12 held-out workloads, it reached 528–866 tokens/s and 1.01× vLLM with MTP. Use Python 3.12 and an NVIDIA CUDA GPU. Download the model and install its dependencies: The original checkpoint also works with Transformers for Qwen's standard text and vision-language workflows; the speed figures above use qwen35fast. - Captured the…

Open weights apache-2.0 2.3B parameters 262,144 tokens transformers

Model · Image and text to text

Qwen2-VL-2B-Instruct

Qwen

We're excited to unveil Qwen2-VL, the latest iteration of our Qwen-VL model, representing nearly a year of innovation. SoTA understanding of images of various resolution & ratio: Qwen2-VL achieves state-of-the-art performance on visual understanding benchmarks, including MathVista, DocVQA, RealWorldQA, MTVQA, etc. Understanding videos of 20min+: Qwen2-VL can understand videos over 20 minutes for high-quality video-based question answering, dialog, content creation, etc. Agent that can operate your mobiles, robots, etc.: with the abilities of complex reasoning and decision making, Qwen2-VL can be integrated with devices like mobile phones, robots, etc., for automatic operation based on…

Open weights apache-2.0 2.2B parameters 32,768 tokens transformers

QARI-OCR v0.3 is a specialized vision-language model fine-tuned for Arabic Optical Character Recognition with a focus on structural document understanding. - Built on Qwen2-VL-2B-Instruct, this model excels at preserving document layouts, HTML tags, and formatting while transcribing Arabic text. - It is described in detail in the paper QARI-OCR: High-Fidelity Arabic Text Recognition through Multimodal Large Language Model Adaptation. While QARI v0.2 achieves better raw text accuracy (CER: 0.061), QARI v0.3 excels in: - HTML/Markdown structure preservation - Document layout understanding - Handwritten text recognition (initial capabilities) - 5x faster training than v0.2 You can load this…

Open weights apache-2.0 2.2B parameters 32,768 tokens transformers

Model · Image and text to text

Qwen3-VL-2B-Instruct

Qwen

Meet Qwen3-VL — the most powerful vision-language model in the Qwen series to date. This generation delivers comprehensive upgrades across the board: superior text understanding & generation, deeper visual perception & reasoning, extended context length, enhanced spatial and video dynamics comprehension, and stronger agent interaction capabilities. Available in Dense and MoE architectures that scale from edge to cloud, with Instruct and reasoning‑enhanced Thinking editions for flexible, on‑demand deployment. Text Understanding on par with pure LLMs: Seamless text–vision fusion for lossless, unified comprehension. 1. Interleaved-MRoPE: Full‑frequency allocation over time, width, and height…

Open weights apache-2.0 2.1B parameters 262,144 tokens transformers