Skip to page content
SAVRN
Search Plan a project

Open-weight model · Text generation

Rem_Mistral_22B

by Timur Tomry0/Rem_Mistral_22B

Rem_Mistral_22B is an open-weight model for text generation from Timur, released under Apache License 2.0. It has 22.2B parameters and a 131,072-token context. At 16-bit it needs about 53.4 GB of GPU memory, which fits on 1x MI300X from $1.85 an hour, at the lowest prices in the SAVRN Index.

This mistral model was trained 2x faster with Unsloth and Huggingface's TRL library.

Parameters22.2B
Context131,072
Weights44.5 GB
Licenseapache-2.0
AccessOpen weights
Monthly Downloads—

Runs On

What it takes to serve Rem_Mistral_22B (22.2B parameters): the memory its weights need at each precision, and the cheapest way to rent enough data-center GPUs to hold them.

PrecisionWeightsMemory neededCheapest setupPer hourAlso fits
16-bit 44.5 GB 53.4 GB 1x MI300X (192 GB)
Vultr
$1.85 1x H100 $1.99 · 1x MI325X $2.00
8-bit 22.2 GB 26.7 GB 1x MI300X (192 GB)
Vultr
$1.85 1x H100 $1.99 · 1x MI325X $2.00
4-bit 11.1 GB 13.3 GB 1x MI300X (192 GB)
Vultr
$1.85 1x H100 $1.99 · 1x MI325X $2.00

Memory is the weights at that precision plus 20% for the runtime and a short context; a long context needs more. Prices are the lowest on-demand hourly rates in the SAVRN Index, read Oct 18, 2026.

Rem_Mistral_22B on every accelerator the SAVRN Index prices, at every precision

Model Card

By Timur, published under apache-2.0, revision 20bec41bee53.

This mistral model was trained 2x faster with Unsloth and Huggingface's TRL library.

Read Timur's full model card

Uploaded finetuned model

  • Developed by: Tomry0
  • License: apache-2.0
  • Finetuned from model : unsloth/Mistral-Small-Instruct-2409-bnb-4bit

This mistral model was trained 2x faster with Unsloth and Huggingface's TRL library.

Configuration

Architecture
MistralForCausalLM
Context length (tokens)
131,072
Layers
56
Hidden size
6,144
Feed-forward size
16,384
Attention heads
48
Key/value heads
8
Head dimension
128
Vocabulary size
32,768
Stored precision
bfloat16
Model type
mistral

Identity and Version

Repository
Tomry0/Rem_Mistral_22B
Publisher
Timur
Task
Text generation
Modality
Text
Library
transformers
Parameters
22.2B parameters
Languages
en
Revision
20bec41bee53b38c8232600d7432d271cca92fd5
First published
2026-10-13
Last updated
2026-10-13

Files and Weights

18 files, 44.5 GB in total. The weights are 9 files totalling 44.5 GB in safetensors.

Weights9 files · 44.5 GB
Configuration3 files · 42.7 KB
Tokenizer3 files · 4.4 MB
Documentation1 file · 615 B
Other1 file · 3.9 KB
Repository1 file · 1.5 KB
Every file
FileTypeSizeSHA-256
model-00001-of-00009.safetensorsWeights4.9 GB de8f7f300486
model-00002-of-00009.safetensorsWeights5.0 GB eaded71665aa
model-00003-of-00009.safetensorsWeights5.0 GB 6b79ff206992
model-00004-of-00009.safetensorsWeights4.9 GB 9ab582cb55e2
model-00005-of-00009.safetensorsWeights5.0 GB 3fc3284118d8
model-00006-of-00009.safetensorsWeights5.0 GB 1038b29b198e
model-00007-of-00009.safetensorsWeights4.9 GB 9d60e2a7b92d
model-00008-of-00009.safetensorsWeights5.0 GB 865761532579
model-00009-of-00009.safetensorsWeights5.0 GB df11e180c33d
config.jsonConfiguration720 B —
generation_config.jsonConfiguration168 B —
model.safetensors.index.jsonConfiguration41.8 KB —
README.mdDocumentation615 B —
chat_template.jinjaOther3.9 KB —
.gitattributesRepository1.5 KB —
tokenizer.jsonTokenizer3.7 MB —
tokenizer.modelTokenizer587.6 KB 59f95e28944c
tokenizer_config.jsonTokenizer141.0 KB —

License and Download

License
apache-2.0
Access
Open weights, no gate
Download size
44.5 GB
Download from Timur

Released by Timur through its official repository on Hugging Face. Read the license.

Built From

  • Derived from unsloth/Mistral-Small-Instruct-2409-bnb-4bit

Memory Requirements

PrecisionWeights in memory
As published44.5 GB
16-bit44.5 GB
8-bit22.2 GB
4-bit11.1 GB

Weights only, from the published parameter count; the key-value cache and runtime add to this.

Questions About Rem_Mistral_22B

How much GPU memory does Rem_Mistral_22B need?

About 53.4 GB at 16-bit and 13.3 GB at 4-bit: the weights (22.2B parameters) plus a working margin. A long context needs more.

What is the cheapest GPU to run Rem_Mistral_22B on?

At 16-bit, 1x MI300X from $1.85 an hour; at 4-bit, 1x MI300X from $1.85 an hour, at the lowest on-demand prices the SAVRN Index lists.

Can I use Rem_Mistral_22B commercially?

Yes. Rem_Mistral_22B is released under Apache License 2.0. The Apache License 2.0 is a permissive open-source license. It permits commercial use, modification and redistribution. It requires keeping the license and copyright notices and any NOTICE file, stating significant changes, and it includes an express patent grant from contributors.

What is Rem_Mistral_22B's context length?

131,072 tokens, from the maximum position embeddings in its published configuration.

Similar Models

A refusal-removed (abliterated) build of Qwen's Qwen3.8-Flash-Next, quantized to EXL3 2.50 bpw so the full model runs on a single 24 GB card (RTX 3090 / 4090) using MoE CPU-offload — with the vision tower, MTP head, native 262,144-token context, and the PLE n-gram table all intact. Requires the same MoE CPU-offload setup as the stock 2.50bpw pack. Needs ~59 GB host RAM for the CPU expert tail and a fast NVMe for the streamed n-gram table. Expected on an RTX 3090: ~38 tok/s decode with MTP on (~28 without), ~20 tok/s at 175K depth, ~664 tok/s prefill. See the upstream repo for the full measured ledger; this quant uses the identical flags and layout, so numbers should track closely. Fired on…

Open weights other 22.3B parameters 262,144 tokens

Model · Text generation

Cyberdonia-24B-v8

Naphula

/ Cockpit & Void Palette / / Hyperspace & Instrument Lights / / Low-framerate flicker keyframes (stepped timing) / / Deep radial hyperspace tunnel backdrop through cockpit window glass / radial-gradient(circle at 50% 45%, rgba(255, 230, 150, 0.25) 0%, rgba(255, 42, 75, 0.25) 18%, rgba(189, 0, 255, 0.2) 36%, rgba(0, 229, 255, 0.15) 54%, transparent 75%), repeating-conic-gradient(from 0deg at 50% 45%, #05070a 0deg 10deg, #0e131d 15deg, #05070a 20deg), radial-gradient(ellipse at center, transparent 30%, #000000 95%); / Low-framerate scanline overlay / / Heavy Flight Deck Chassis Container / 0 0 50px rgba(0, 0, 0, 0.9), inset 0 0 35px rgba(0, 0, 0, 0.8), inset 0 1px 0 rgba(255, 255, 255, 0.1)…

Open weights apache-2.0 23.6B parameters 131,072 tokens transformers

"Abliterated Dolphin" is a result of my 3AM brain reading about technique called abliteration and then thinking what would happen if I tried to abliterate a model that is already relatively free, such as Dolphin. Heavily inspired by mlabonne's article on abliteration on how to redirect refusals and effectively remove, or ablate, censorship from a language model. There is really no deeper meaning to any of this than pure curiosity. This is basically a dumbed down version of the original Dolphin model I used as a base, as I have not done any DPOs to heal the damage caused by abliteration. Don't try to do anything meaningful with this model. Use the original Dolphin3.0-R1-Mistral-24B instead.…

Open weights apache-2.0 23.6B parameters 32,768 tokens transformers

Model · Text generation

gpt-oss-20b

OpenAI

Welcome to the gpt-oss series, OpenAI’s open-weight models designed for powerful reasoning, agentic tasks, and versatile developer use cases. We’re releasing two flavors of these open models: - gpt-oss-120b — for production, general purpose, high reasoning use cases that fit into a single 80GB GPU (like NVIDIA H100 or AMD MI300X) (117B parameters with 5.1B active parameters) - gpt-oss-20b — for lower latency, and local or specialized use cases (21B parameters with 3.6B active parameters) Both models were trained on our harmony response format and should only be used with the harmony format as it will not work correctly otherwise. You can use gpt-oss-120b and gpt-oss-20b with Transformers.…

Open weights apache-2.0 20.9B parameters 131,072 tokens transformers

Model · Text generation

Gemma-4-31B-IT-NVFP4

NVIDIA

Gemma 4 31B IT is an open multimodal model built by Google DeepMind that handles text and image inputs, can process video as sequences of frames, and generates text output. It is designed to deliver frontier-level performance for reasoning, agentic workflows, coding, and multimodal understanding on consumer GPUs and workstations, with a 256K-token context window and support for over 140 languages. The model uses a hybrid attention mechanism that interleaves local sliding-window and full global attention, with unified Keys and Values in global layers and Proportional RoPE (p-RoPE) to support long-context performance. The NVIDIA Gemma 4 31B IT NVFP4 model is quantized with NVIDIA Model…

Open weights other 20.9B parameters 262,144 tokens Model Optimizer

Model · Text generation

gpt-neox-20b

EleutherAI

GPT-NeoX-20B is a 20 billion parameter autoregressive language model trained on the Pile using the GPT-NeoX library. Its architecture intentionally resembles that of GPT-3, and is almost identical to that of GPT-J- 6B. Its training dataset contains a multitude of English-language texts, reflecting the general-purpose nature of this model. See the accompanying paper for details about model architecture (including how it differs from GPT-3), training procedure, and additional evaluations. Model](https://arxiv.org/abs/2204.06745). For details about the training dataset, see the Pile paper, and its data sheet. Discord](https://discord.gg/zBGx3azzUn), and post them in #release-discussion. Please…

Open weights apache-2.0 20.7B parameters 2,048 tokens transformers