This gemma4 model was trained 2x faster with Unsloth and Huggingface's TRL library.
cpt8 is an open-weight model for image and text to text from Xabxa. It has 5.1B parameters and a 131,072-token context. At 16-bit it needs about 12.3 GB of GPU memory, which fits on 1x MI300X from $1.85 an hour, at the lowest prices in the SAVRN Index.
This model is a fine-tuned version of Agtian/cpt8. It has been trained using TRL. This model was trained with SFT.
Runs On
What it takes to serve cpt8 (5.1B parameters): the memory its weights need at each precision, and the cheapest way to rent enough data-center GPUs to hold them.
| Precision | Weights | Memory needed | Cheapest setup | Per hour | Also fits |
|---|---|---|---|---|---|
| 16-bit | 10.2 GB | 12.3 GB | 1x MI300X (192 GB) Vultr |
$1.85 | 1x H100 $1.99 · 1x MI325X $2.00 |
| 8-bit | 5.1 GB | 6.1 GB | 1x MI300X (192 GB) Vultr |
$1.85 | 1x H100 $1.99 · 1x MI325X $2.00 |
| 4-bit | 2.6 GB | 3.1 GB | 1x MI300X (192 GB) Vultr |
$1.85 | 1x H100 $1.99 · 1x MI325X $2.00 |
Memory is the weights at that precision plus 20% for the runtime and a short context; a long context needs more. Prices are the lowest on-demand hourly rates in the SAVRN Index, read Oct 18, 2026.
cpt8 on every accelerator the SAVRN Index prices, at every precision
Model Card
This model is a fine-tuned version of Agtian/cpt8. It has been trained using TRL. This model was trained with SFT.
Excerpt from the card by Xabxa.
Configuration
- Architecture
- Gemma4ForConditionalGeneration
- Context length (tokens)
- 131,072
- Layers
- 35
- Hidden size
- 1,536
- Feed-forward size
- 6,144
- Attention heads
- 8
- Key/value heads
- 1
- Head dimension
- 256
- Vocabulary size
- 262,144
- Sliding window (tokens)
- 512
- Stored precision
- bfloat16
- Model type
- gemma4
Identity and Version
- Repository
- Agtian/cpt8
- Publisher
- Xabxa
- Task
- Image and text to text
- Modality
- Image and text
- Library
- transformers
- Parameters
- 5.1B parameters
- Languages
- sft, trl
- Revision
- 8c86efb00f5f38bbc92ccd7ba731a7c0581a0ccc
- First published
- 2026-10-11
- Last updated
- 2026-10-12
Files and Weights
24 files, 16.7 GB in total. The weights are 8 files totalling 16.7 GB in bin, pt, pth, safetensors.
Every file
| File | Type | Size | SHA-256 |
|---|---|---|---|
| adapter_model.safetensors | Weights | 2.0 GB | 8d2cd1c81196 |
| last-checkpoint/adapter_model.safetensors | Weights | 2.0 GB | 8d2cd1c81196 |
| last-checkpoint/optimizer.pt | Weights | 2.4 GB | c95bae8b3728 |
| last-checkpoint/rng_state.pth | Weights | 14.6 KB | f1d565802a8e |
| last-checkpoint/scheduler.pt | Weights | 1.5 KB | c4b71523a980 |
| last-checkpoint/training_args.bin | Weights | 5.8 KB | 0bf4d5923f30 |
| model.safetensors | Weights | 10.2 GB | 62b029651220 |
| training_args.bin | Weights | 5.8 KB | 0bf4d5923f30 |
| adapter_config.json | Configuration | 1.7 KB | — |
| config.json | Configuration | 5.8 KB | — |
| generation_config.json | Configuration | 203 B | — |
| last-checkpoint/adapter_config.json | Configuration | 1.7 KB | — |
| last-checkpoint/processor_config.json | Configuration | 1.7 KB | — |
| last-checkpoint/trainer_state.json | Configuration | 76.1 KB | — |
| processor_config.json | Configuration | 1.7 KB | — |
| README.md | Documentation | 1.4 KB | — |
| last-checkpoint/README.md | Documentation | 5.2 KB | — |
| chat_template.jinja | Other | 17.3 KB | — |
| last-checkpoint/chat_template.jinja | Other | 17.3 KB | — |
| .gitattributes | Repository | 1.6 KB | — |
| last-checkpoint/tokenizer.json | Tokenizer | 32.2 MB | cc8d3a0ce364 |
| last-checkpoint/tokenizer_config.json | Tokenizer | 6.9 KB | — |
| tokenizer.json | Tokenizer | 32.2 MB | cc8d3a0ce364 |
| tokenizer_config.json | Tokenizer | 6.9 KB | — |
License and Download
- License
- Not stated by the source
- Access
- Open weights, no gate
- Download size
- 16.7 GB
Released by Xabxa through its official repository on Hugging Face.
Built From
- Derived from Agtian/cpt8
Memory Requirements
| Precision | Weights in memory |
|---|---|
| As published | 16.7 GB |
| 16-bit | 10.2 GB |
| 8-bit | 5.1 GB |
| 4-bit | 2.6 GB |
Weights only, from the published parameter count; the key-value cache and runtime add to this.
Built on This Model
- Derived fromcpt8
Questions About cpt8
How much GPU memory does cpt8 need?
About 12.3 GB at 16-bit and 3.1 GB at 4-bit: the weights (5.1B parameters) plus a working margin. A long context needs more.
What is the cheapest GPU to run cpt8 on?
At 16-bit, 1x MI300X from $1.85 an hour; at 4-bit, 1x MI300X from $1.85 an hour, at the lowest on-demand prices the SAVRN Index lists.
What is cpt8's context length?
131,072 tokens, from the maximum position embeddings in its published configuration.
Similar Models
This is a modified version of google/translategemma-4b-it optimized for deployment with vLLM. The original TranslateGemma model requires a structured payload with dedicated sourcelangcode and targetlangcode fields: However, vLLM does not support these custom content parameters. To maintain compatibility, the chat template has been modified to encode language codes directly in the message content using a delimiter-based format: Format: >>{sourcelang} >>{targetlang} >>{texttotranslate} If you need to provide a custom prompt input The original model uses the new Transformers RoPE configuration format with separate attention type settings: This has been simplified for vLLM compatibility: The…
Chandra 2 is a state of the art OCR model from Datalab that outputs markdown, HTML, and JSON. It is highly accurate at extracting text from images and PDFs, while preserving layout information. Try Chandra in the free playground, or use the hosted API for higher accuracy and speed. - 85.8% olmocr bench score (sota), 77.8% multilingual bench score (12% improvement over Chandra 1) - Significant improvements to math, tables, complex layouts - 90+ language support with major accuracy gains - Convert documents to markdown, HTML, or JSON with detailed layout information - Reconstructs forms accurately, including checkboxes - Strong performance with tables, math, and complex layouts - Extracts…
Expert-paged build of Vontra/Qwen3.8-Flash-Next-MLX-4bit. The weights that are read a fraction at a time live in their own containers, so a machine loads what it needs rather than all Total 105.46 GiB. Of that, 103.94 GiB is the source build, whose bytes moved into containers rather than being copied, and 1.52 GiB is the draft head, which no published build of this model carries. Where the weights fit they are filled from experts.bin and the model runs the stock path at stock speed; where they do not, they stream from disk. Reading the machine decides that, not a flag. To override that: GBXPAGING=off holds the experts resident, GBXPLE=off holds the n-gram table resident. Checked at build…
Papers: https://arxiv.org/abs/2609.19745 (Vision-RL²) · https://arxiv.org/abs/2509.16944 (SD-RPN) SD-RPN stage-1 checkpoint: a self-distilled RoI predictor twig (K = 21, T = 3) trained on a frozen Qwen/Qwen3.5-4B. This is the initialisation of the Vision-RL² RL run YuhengSSS/VisionRL2-Qwen3.5-4B. The backbone weights are unchanged from the base model; only the three attached twig blocks are trained, from self-distilled attention pseudo-labels (no human RoI annotation). These weights need the modeling code in YuHengsss/VisionRL2. They are not loadable for RoI inference through a plain AutoModel / AutoModelForCausalLM call: the RoI gating path (heatmap head, peak-relative gate…
Over recent months, we have intensified our focus on developing foundation models that deliver exceptional utility and performance. Qwen3.5 represents a significant leap forward, integrating breakthroughs in multimodal learning, architectural efficiency, reinforcement learning scale, and global accessibility to empower developers and enterprises with unprecedented capability and efficiency. For more details, please refer to our blog post Qwen3.5. WMT24++: a harder subset of WMT24 after difficulty labeling and rebalancing; we report the averaged scores on 55 languages using XCOMET-XXL. Empty cells (--) indicate scores not yet available or not applicable. Empty cells (--) indicate scores not…