SAVRN
Search Contact SAVRN

Open-weight model · Image and text to text

Omni-Edu-4B

by Hao Liang lhpku20010120/Omni-Edu-4B

This model is a fine-tuned version of Qwen/Qwen3.5-4B-Base on the Omni-Edu-70K dataset.

Parameters4.5B
Context262,144
Weights9.1 GB
Licenseother
AccessOpen weights
Monthly Downloads14

Runs On

What it takes to serve Omni-Edu-4B (4.5B parameters): the memory its weights need at each precision, and the cheapest way to rent enough data-center GPUs to hold them.

PrecisionWeightsMemory neededCheapest setupPer hourAlso fits
16-bit 9.1 GB 10.9 GB 1x MI300X (192 GB)
Vultr
$1.85 1x H100 $1.99 · 1x MI325X $2.00
8-bit 4.5 GB 5.4 GB 1x MI300X (192 GB)
Vultr
$1.85 1x H100 $1.99 · 1x MI325X $2.00
4-bit 2.3 GB 2.7 GB 1x MI300X (192 GB)
Vultr
$1.85 1x H100 $1.99 · 1x MI325X $2.00

Memory is the weights at that precision plus 20% for the runtime and a short context; a long context needs more. Prices are the lowest on-demand hourly rates in the SAVRN Index, read Sep 18, 2026.

Model Card

This model is a fine-tuned version of Qwen/Qwen3.5-4B-Base on the Omni-Edu-70K dataset. The following hyperparameters were used during training: - learningrate: 5e-06 - trainbatchsize: 1 - evalbatchsize: 8 - distributedtype: multi-GPU - numdevices: 8 - gradientaccumulationsteps: 8 - totaltrainbatchsize: 64 - totalevalbatchsize: 64 - lrschedulertype: cosine - lrschedulerwarmupsteps: 0.1 - numepochs: 3.0 - Transformers 5.2.0 - Pytorch 2.10.0 - Datasets 4.0.0 - Tokenizers 0.22.2

Excerpt from the card by Hao Liang, licensed other.

Configuration

Architecture
Qwen3_5ForConditionalGeneration
Context length (tokens)
262,144
Layers
32
Hidden size
2,560
Feed-forward size
9,216
Attention heads
16
Key/value heads
4
Head dimension
256
Vocabulary size
248,320
Model type
qwen3_5

Identity and Version

Repository
lhpku20010120/Omni-Edu-4B
Publisher
Hao Liang
Task
Image and text to text
Modality
Image and text
Library
transformers
Parameters
4.5B parameters
Languages
Not stated by the source
Revision
7e95b404819b6526bd7968f0458e61436aa57f74
First published
2026-09-16
Last updated
2026-09-18

Files and Weights

15 files, 9.1 GB in total. The weights are 2 files totalling 9.1 GB in bin, safetensors.

Weights2 files · 9.1 GB
Configuration6 files · 66.1 KB
Tokenizer2 files · 20.0 MB
Documentation1 file · 1.4 KB
Other3 files · 119.3 KB
Repository1 file · 1.6 KB
Every file
FileTypeSizeSHA-256
model.safetensorsWeights9.1 GB 5d99f30cb95d
training_args.binWeights7.8 KB a4e5586e1c5c
all_results.jsonConfiguration204 B
config.jsonConfiguration2.9 KB
generation_config.jsonConfiguration163 B
processor_config.jsonConfiguration1.3 KB
train_results.jsonConfiguration204 B
trainer_state.jsonConfiguration61.3 KB
README.mdDocumentation1.4 KB
chat_template.jinjaOther7.8 KB
trainer_log.jsonlOther67.9 KB
training_loss.pngOther43.7 KB
.gitattributesRepository1.6 KB
tokenizer.jsonTokenizer20.0 MB 87a7830d63fc
tokenizer_config.jsonTokenizer1.2 KB

License and Download

License
other
Access
Open weights, no gate
Download size
9.1 GB
Download from Hao Liang

Released by Hao Liang through its official repository on Hugging Face.

Memory Requirements

PrecisionWeights in memory
As published9.1 GB
16-bit9.1 GB
8-bit4.5 GB
4-bit2.3 GB

Weights only, from the published parameter count; the key-value cache and runtime add to this.

Questions About Omni-Edu-4B

How much GPU memory does Omni-Edu-4B need?

About 10.9 GB at 16-bit and 2.7 GB at 4-bit: the weights (4.5B parameters) plus a working margin. A long context needs more.

What is the cheapest GPU to run Omni-Edu-4B on?

At 16-bit, 1x MI300X from $1.85 an hour; at 4-bit, 1x MI300X from $1.85 an hour, at the lowest on-demand prices the SAVRN Index lists.

What license is Omni-Edu-4B released under?

other, as its publisher declares it. Read the license text before commercial use.

What is Omni-Edu-4B's context length?

262,144 tokens, from the maximum position embeddings in its published configuration.

Similar Models

Model · Image and text to text

Qwen3-VL-4B-Instruct

Qwen

Meet Qwen3-VL — the most powerful vision-language model in the Qwen series to date. This generation delivers comprehensive upgrades across the board: superior text understanding & generation, deeper visual perception & reasoning, extended context length, enhanced spatial and video dynamics comprehension, and stronger agent interaction capabilities. Available in Dense and MoE architectures that scale from edge to cloud, with Instruct and reasoning‑enhanced Thinking editions for flexible, on‑demand deployment. Text Understanding on par with pure LLMs: Seamless text–vision fusion for lossless, unified comprehension. 1. Interleaved-MRoPE: Full‑frequency allocation over time, width, and height…

Open weights apache-2.0 4.4B parameters 262,144 tokens transformers

Model · Image and text to text

Qwen3.5-4B

Qwen

Over recent months, we have intensified our focus on developing foundation models that deliver exceptional utility and performance. Qwen3.5 represents a significant leap forward, integrating breakthroughs in multimodal learning, architectural efficiency, reinforcement learning scale, and global accessibility to empower developers and enterprises with unprecedented capability and efficiency. For more details, please refer to our blog post Qwen3.5. WMT24++: a harder subset of WMT24 after difficulty labeling and rebalancing; we report the averaged scores on 55 languages using XCOMET-XXL. Empty cells (--) indicate scores not yet available or not applicable. Empty cells (--) indicate scores not…

Open weights apache-2.0 4.7B parameters 262,144 tokens transformers

Model · Image and text to text

gemma-3-4b-it

Google

[Gemma 3 Technical Report][g3-tech-report] [Responsible Generative AI Toolkit][rai-toolkit] [Gemma on Kaggle][kaggle-gemma] [Gemma on Vertex Model Garden][vertex-mg-gemma3] Summary description and brief definition of inputs and outputs. Gemma is a family of lightweight, state-of-the-art open models from Google, built from the same research and technology used to create the Gemini models. Gemma 3 models are multimodal, handling text and image input and generating text output, with open weights for both pre-trained variants and instruction-tuned variants. Gemma 3 has a large, 128K context window, multilingual support in over 140 languages, and is available in more sizes than previous…

Access requested at publisher gemma 4.3B parameters transformers

Model · Image and text to text

medgemma-4b-it

Google

Model on Google Cloud Model Garden: MedGemma GitHub repository (supporting code, Colab notebooks, discussions, and Foundations terms of use](https://developers.google.com/health-ai-developer-foundations/terms). This section describes the MedGemma model and how to use it. MedGemma is a collection of Gemma 3 variants that are trained for performance on medical text and image comprehension. Developers can use MedGemma to accelerate building healthcare-based AI applications. MedGemma currently comes in three variants: a 4B multimodal version and 27B text-only and multimodal versions. Both MedGemma multimodal versions utilize a SigLIP image encoder that has been specifically pre-trained on a…

Access requested at publisher other 4.3B parameters transformers

Model · Image and text to text

vllm-translategemma-4b-it

Infomaniak Network SA

This is a modified version of google/translategemma-4b-it optimized for deployment with vLLM. The original TranslateGemma model requires a structured payload with dedicated sourcelangcode and targetlangcode fields: However, vLLM does not support these custom content parameters. To maintain compatibility, the chat template has been modified to encode language codes directly in the message content using a delimiter-based format: Format: >>{sourcelang} >>{targetlang} >>{texttotranslate} If you need to provide a custom prompt input The original model uses the new Transformers RoPE configuration format with separate attention type settings: This has been simplified for vLLM compatibility: The…

Open weights gemma 5B parameters 131,072 tokens transformers

Model · Image and text to text

Rex-Omni

IDEA-Research

This model is Rex-Omni, a 3B-parameter Multimodal Large Language Model (MLLM) presented in the paper "Detect Anything via Next Point Prediction". It is compatible with the Hugging Face transformers library and is licensed under the IDEA License 1.0. src="https://img.shields.io/badge/RexOmni-Website-BADFDB?style=flat-square&logo=deno&logoColor=violet&color=BADFDB" alt="RexThinker Website" src="https://img.shields.io/badge/RexOmni-Paper-Red%25red?logo=arxiv&logoColor=red&color=yellow" alt="RexThinker Paper on arXiv" src="https://img.shields.io/badge/RexOmni-Weight-orange?logo=huggingface&logoColor=yellow" alt="RexThinker weight on Hugging Face"…

Open weights other 4.1B parameters 128,000 tokens transformers