SAVRN
Search Contact SAVRN

Open-weight model · Text generation

KAT-Coder-V2.5-Dev-APEX-I-MiniPlus-V2.1-GGUF

by IsValorum IsValorum/KAT-Coder-V2.5-Dev-APEX-I-MiniPlus-V2.1-GGUF

We maintain our previous releases publicly as a transparent engineering record of continuous optimization. Below is the exact evolutionary roadmap of our MiniPlus architectures

Parameters
Context
Weights6.1 KB
Licenseapache-2.0
AccessOpen weights
Monthly Downloads

Model Card

By IsValorum, published under apache-2.0, revision f0515ffc347e.

We maintain our previous releases publicly as a transparent engineering record of continuous optimization. Below is the exact evolutionary roadmap of our MiniPlus architectures

Read IsValorum's full model card

The Definitive Frontier MoE · Blistering +24 to 28+ tok/s with Aggressive Partial Offload (DDR4 RAM) · Full 256K Context on 24GB Workstations

[!IMPORTANT]

THE DEFINITIVE SPECIFICATION IN THE 13–14 GB CEILING

This APEX-I-MiniPlus-V2.1 release represents the absolute technological limit of sparse Mixture-of-Experts quantization within the 13–14 GB envelope. Every single tensor of its 40 layers and 256 micro-experts has been mathematically audited to maximize reasoning precision, eliminate recurrence state drift, and prevent AVX2 CPU dequantization stalls.

[!WARNING]

DO NOT CONFUSE WITH GENERIC COMMUNITY APEX-I-MINI RELEASES!

Our APEX-I-MiniPlus builds (engineered by IsValorum) are completely custom, handcrafted, tensor-by-tensor architectures designed specifically for hybrid MoE models. Generic community APEX-I-Mini recipes uniformly compress all core experts down to 2-bit IQ2_S, leave the token output head unarmored at 3-bit Q3_K_M, and compress attention projections down to Q3_K. In deep reasoning models, that causes severe perplexity degradation, broken code syntax/brackets, and collapsed reasoning. APEX-I-MiniPlus was built to eliminate this flaw permanently.


Optimization History & Transparency Notice

We maintain our previous releases publicly as a transparent engineering record of continuous optimization. Below is the exact evolutionary roadmap of our MiniPlus architectures:

Specification Core Experts (10–29) Edge Experts (0–9, 30–39) Shared Expert (shexp) Full Attention (L3, 7, 11, ...) Output Head (output.weight) Routers (gate_inp) Size / Overhead Real-World Impact
Generic APEX Mini IQ2_S (2.50 bpw) Q3_K (only 5 layers) Q4_K / Q3_K Q3_K Q3_K_M Compressed Baseline (~12.5 GB) Severe syntax errors, broken code indentation, high perplexity in <think>.
MiniPlus V1 IQ3_XXS (3.06 bpw) Q3_K (5 layers) Q4_K / IQ4_NL Q3_K Q6_K F32 (uncompressed) +1.1 GB vs generic Rescued core reasoning; zero router drift; eliminated vocabulary hallucinations.
MiniPlus V2 (Legacy) IQ3_XXS IQ3_S (10 layers) IQ4_NL Q3_K + Q8_0 gates Q6_K F32 +1.2 GB vs generic Expanded protective edge envelope; enhanced long-context attention gating.
MiniPlus V2.1 (CURRENT) IQ3_XXS Q3_K (10 layers) Q5_K (All 40 layers) Q4_K (q/k/v) + Q6_K (output) Q6_K F32 < 100 MB extra over V2 (13.74 GiB total) Zero AVX2 CPU stalls; +24 to 28+ tok/s streaming under aggressive offload (very few layers in VRAM, bulk in DDR4 RAM); rock-solid foundation knowledge; flawless needle-in-a-haystack retrieval.

Model Files & Specifications

File Name File Size Memory Footprint BPW Description
KAT-Coder-V2.5-Dev.APEX-I-MiniPlus-V2.1.gguf 13.74 GiB 13.74 GiB 3.40 BPW Core distilled reasoning, chain-of-thought math, logic & coding MoE
  • Base Model: Kwaipilot/KAT-Coder-V2.5-Dev
  • Architecture: 40 layers, 256 micro-experts (8 active per token)
  • Context Length: 262,144 tokens (native)

Extreme Offload Benchmarks (Minimal VRAM + Standard DDR4 RAM)

Empirically Verified in Unsloth Studio & llama.cpp under Aggressive Offload

  • Offload Configuration: Aggressive hybrid offload — very few layers offloaded to VRAM (~4.2 GB VRAM footprint), with the bulk of the model actively streaming from standard DDR4 system RAM.
  • Prompt Processing (Prefill): 385.70 to 407.24 tokens/second sustained.
  • Streaming Text Generation: 24.25 to 28.37 tokens/second sustained with reasoning enabled.
  • Memory Footprint: 13.74 GiB weights fits effortlessly within typical 16GB / 32GB DDR4 configurations without paging crashes or stutter.

Identity and Version

Repository
IsValorum/KAT-Coder-V2.5-Dev-APEX-I-MiniPlus-V2.1-GGUF
Publisher
IsValorum
Task
Text generation
Modality
Text
Library
gguf
Parameters
Not stated by the source
Languages
en, zh, es, fr, de, pt, it, ru
Revision
f0515ffc347e0bc4719fda0d9c672e475152febf
First published
2026-09-18
Last updated
2026-09-18

Files and Weights

2 files, 6.1 KB in total.

Documentation1 file · 4.6 KB
Repository1 file · 1.5 KB
Every file
FileTypeSizeSHA-256
README.mdDocumentation4.6 KB
.gitattributesRepository1.5 KB

License and Download

License
apache-2.0
Access
Open weights, no gate
Download from IsValorum

Released by IsValorum through its official repository on Hugging Face. Read the license.

Built From

  • Derived from Kwaipilot/KAT-Coder-V2.5-Dev

Questions About KAT-Coder-V2.5-Dev-APEX-I-MiniPlus-V2.1-GGUF

Can I use KAT-Coder-V2.5-Dev-APEX-I-MiniPlus-V2.1-GGUF commercially?

Yes. KAT-Coder-V2.5-Dev-APEX-I-MiniPlus-V2.1-GGUF is released under Apache License 2.0. The Apache License 2.0 is a permissive open-source license. It permits commercial use, modification and redistribution. It requires keeping the license and copyright notices and any NOTICE file, stating significant changes, and it includes an express patent grant from contributors.

Similar Models

Fine-tune Qwen3 (14B) for free using our Google Colab notebook! - Read our Blog about Qwen3 support: unsloth.ai/blog/qwen3 - View the rest of our notebooks in our docs here. Qwen3-Coder is available in multiple sizes. Today, we're excited to introduce Qwen3-Coder-30B-A3B-Instruct. This streamlined model maintains impressive performance and efficiency, featuring the following key enhancements: - Significant Performance among open models on Agentic Coding, Agentic Browser-Use, and other foundational coding tasks. - Long-context Capabilities with native support for 256K tokens, extendable up to 1M tokens using Yarn, optimized for repository-scale understanding. - Agentic Coding supporting for…

Open weights apache-2.0 transformers

Model · Text generation

opt-125m

AI at Meta

OPT was first introduced in Open Pre-trained Transformer Language Models and first released in metaseq's repository on May 3rd 2022 by Meta AI. Disclaimer: The team releasing OPT wrote an official model card, which is available in Appendix D of the paper. Content from this model card has been written by the Hugging Face team. To quote the first two paragraphs of the official paper OPT was predominantly pretrained with English text, but a small amount of non-English data is still present within the training corpus via CommonCrawl. The model was pretrained using a causal language modeling (CLM) objective. OPT belongs to the same family of decoder-only models like GPT-3. As such, it was…

Open weights other 2,048 tokens transformers

Model · Text generation

Ornith-1.5-9B-GGUF

Ornith

Chirp Chirp! We are introducing Ornith-1.5, a major step toward building foundation models through end-to-end self-improvement. Ornith-1.5 extends Ornith-1.0 (which was developed on top of Qwen3.5 and Gemma4 with additional continued pretraining, mid-training, and post-training) by expanding the self-improvement loop from scaffold and rollout optimization to jointly optimizing task generation, scaffold construction, and solution rollouts. Rather than relying on a fixed set of human-curated tasks and manually designed harnesses, Ornith-1.5 continuously generates new training tasks, discovers effective strategies for solving them, and improves the policy through reinforcement learning. For…

Open weights mit transformers

Model · Text generation

Ornith-1.5-35B-A3B-GGUF

Ornith

Chirp Chirp! We are introducing Ornith-1.5, a major step toward building foundation models through end-to-end self-improvement. Ornith-1.5 extends Ornith-1.0 (which was developed on top of Qwen3.5 and Gemma4 with additional continued pretraining, mid-training, and post-training) by expanding the self-improvement loop from scaffold and rollout optimization to jointly optimizing task generation, scaffold construction, and solution rollouts. Rather than relying on a fixed set of human-curated tasks and manually designed harnesses, Ornith-1.5 continuously generates new training tasks, discovers effective strategies for solving them, and improves the policy through reinforcement learning. For…

Open weights mit transformers

Model · Text generation

Ornith-1.0-9B-GGUF

Ornith

Aloha! Today, we are releasing Ornith-1.0, a self-improving family of open-source models for agentic coding. This model card documents Ornith-1.0-9B, the most lightweight member of the Ornith family, designed for efficient single-GPU deployment. Ornith-1.0-9B is a dense ~9B model (≈19 GB in bf16), so it serves comfortably on a single 80GB GPU. The recipes below stand up an OpenAI-compatible server; add --tensor-parallel-size / --tp if you want to shard across more GPUs. For a quick local test (or to script offline generation), load the model directly with Transformers. Make sure you have a recent release installed — see the Transformers installation guide; Ornith-1.0-9B requires…

Open weights mit transformers

Uncensored Qwen3.8-27B, published as GGUF quantizations with the multi token prediction (MTP) head retained and verified. Refusal behaviour has been substantially reduced, not eliminated. See Measured behaviour for the numbers. Capabilities, training data, and architecture are otherwise unchanged. - Refusal directions removed with Heretic, which co minimizes refusal count against KL divergence from the base model. No handwritten refusal removal code, no finetuning, no additional training data. - Abliteration runs at bf16 (no 4 bit quantization). the resulting LoRA is merged into the bf16 base, so the published weights are not a quantized round trip. - mtp. tensors are copied verbatim from…

Open weights apache-2.0 llama.cpp