Skip to page content
SAVRN
Search Plan a project

Open-weight model · Text generation

MiniCPM5-2B-Math-GGUF

by Caldalis Caldalis/MiniCPM5-2B-Math-GGUF

MiniCPM5-2B-Math-GGUF is an open-weight model for text generation from Caldalis, released under Apache License 2.0. Its published files total 9.3 GB.

GGUF builds of MiniCPM5-2B-Math, a 2.5B math and proof specialist, for llama.cpp, Ollama and LM Studio. Pair it with the MiniCPM-Math Harness to run a small proof swarm on a laptop.

Parameters—
Context—
Weights9.3 GB
Licenseapache-2.0
AccessOpen weights
Monthly Downloads—

Model Card

By Caldalis, published under apache-2.0, revision a1d8abba355a.

GGUF builds of MiniCPM5-2B-Math, a 2.5B math and proof specialist, for llama.cpp, Ollama and LM Studio. Pair it with the MiniCPM-Math Harness to run a small proof swarm on a laptop. Converted with llama.cpp b10964 (converthftogguf.py, tokenizer pre-type minicpm5) and quantized with llama-quantize. The files load on llama.cpp b9354 or newer, which added the MiniCPM5 tokenizer; use b9833 or newer, which added the MiniCPM5 chat parser that separates the reasoning from the answer. The recommended sampling settings (temperature 0.9, top-p 0.95, min-p 0, top-k off) are embedded in the GGUF metadata, so llama.cpp uses them by default. All results on the model card were measured with the BF16…

Read Caldalis's full model card

GGUF builds of MiniCPM5-2B-Math, a 2.5B math and proof specialist, for llama.cpp, Ollama and LM Studio. Pair it with the MiniCPM-Math Harness to run a small proof swarm on a laptop.

[!Note] A personal release, not an official OpenBMB or ModelBest model. It is based on OpenBMB's open MiniCPM5-2B model.

File Size Notes
MiniCPM5-2B-Math-Q4_K_M.gguf 1.6 GB smallest; quality loss likely on long proofs
MiniCPM5-2B-Math-Q8_0.gguf 2.7 GB recommended: usually close to BF16, and used for our laptop tests
MiniCPM5-2B-Math-BF16.gguf 5.0 GB full precision

Converted with llama.cpp b10964 (convert_hf_to_gguf.py, tokenizer pre-type minicpm5) and quantized with llama-quantize. The files load on llama.cpp b9354 or newer, which added the MiniCPM5 tokenizer; use b9833 or newer, which added the MiniCPM5 chat parser that separates the reasoning from the answer. The recommended sampling settings (temperature 0.9, top-p 0.95, min-p 0, top-k off) are embedded in the GGUF metadata, so llama.cpp uses them by default. All results on the model card were measured with the BF16 safetensors on vLLM. The GGUF files were only tried in short runs with llama.cpp, so results with them, especially with Q4_K_M, may differ.

File SHA-256
MiniCPM5-2B-Math-Q4_K_M.gguf 9ff4f86fd8eb3a16b1ff6b29d86366f3c963320e44a7325e6fb90c0142a7cf0b
MiniCPM5-2B-Math-Q8_0.gguf db251717a4d11b3221e7e2f1d096c3aebec94b1f25e8e24b4ebc56c185d32b9d
MiniCPM5-2B-Math-BF16.gguf 0703334ee732e110ef18dee427a8736fae52fbdd8a6ce3510de0df45dcaac72c

llama.cpp

llama-server -hf Caldalis/MiniCPM5-2B-Math-GGUF:Q8_0 --jinja -ngl 99 -c 98304 -np 4 -kvu --port 8000
  • --jinja uses the embedded chat template (thinking mode, <think> … </think>).
  • -np 4 -kvu gives 4 parallel slots that share a 96K-token KV cache: one slot per agent for the harness. Run the harness with --profile quick against this server.
  • --port 8000 is where the harness looks by default; without it, llama-server listens on 8080.
  • The embedded defaults already set min_p=0; llama.cpp's usual 0.05 can encourage repetition with this model.

Measured on an Apple M5 (16 GB) with Q8_0: about 46 tok/s for a single stream, about 125 tok/s total with 4 slots.

Ollama

ollama run hf.co/Caldalis/MiniCPM5-2B-Math-GGUF:Q8_0

Not tested by us. Use Ollama 0.31.1 or newer, the first release whose llama.cpp (b9840) has the MiniCPM5 chat parser; 0.33.3 or newer also applies the sampling defaults embedded in the GGUF. Start the server with a larger context window (for example OLLAMA_CONTEXT_LENGTH=65536 ollama serve), because proofs routinely need tens of thousands of tokens. With the harness, pass --base-url http://127.0.0.1:11434/v1 --model hf.co/Caldalis/MiniCPM5-2B-Math-GGUF:Q8_0 --no-raw.

Recommended settings

temperature=0.9, top_p=0.95, min_p=0.0, thinking enabled, and a large max_tokens. The published benchmark numbers let every call use the full 131,072-token context: a quarter of HMMT samples think past 64K tokens, and many of those still end with the right answer. On a laptop, 16K–32K is a practical compromise.

License

Apache-2.0 (see LICENSE).

Identity and Version

Repository
Caldalis/MiniCPM5-2B-Math-GGUF
Publisher
Caldalis
Task
Text generation
Modality
Text
Library
gguf
Parameters
Not stated by the source
Languages
en, zh
Revision
a1d8abba355a1093f0c25f902d22d3e3bf52bf23
First published
2026-10-09
Last updated
2026-10-10

Files and Weights

6 files, 9.3 GB in total. The weights are 3 files totalling 9.3 GB in gguf.

Weights3 files · 9.3 GB
Documentation2 files · 15.1 KB
Repository1 file · 1.7 KB
Every file
FileTypeSizeSHA-256
MiniCPM5-2B-Math-BF16.ggufWeights5.0 GB 0703334ee732
MiniCPM5-2B-Math-Q4_K_M.ggufWeights1.6 GB 9ff4f86fd8eb
MiniCPM5-2B-Math-Q8_0.ggufWeights2.7 GB db251717a4d1
LICENSEDocumentation11.4 KB —
README.mdDocumentation3.7 KB —
.gitattributesRepository1.7 KB —

License and Download

License
apache-2.0
Access
Open weights, no gate
Download size
9.3 GB
Download from Caldalis

Released by Caldalis through its official repository on Hugging Face. Read the license.

Built From

Memory Requirements

PrecisionWeights in memory
As published9.3 GB

Weights only, from the published parameter count; the key-value cache and runtime add to this.

Questions About MiniCPM5-2B-Math-GGUF

Can I use MiniCPM5-2B-Math-GGUF commercially?

Yes. MiniCPM5-2B-Math-GGUF is released under Apache License 2.0. The Apache License 2.0 is a permissive open-source license. It permits commercial use, modification and redistribution. It requires keeping the license and copyright notices and any NOTICE file, stating significant changes, and it includes an express patent grant from contributors.

Similar Models

Model · Text generation

opt-125m

AI at Meta

OPT was first introduced in Open Pre-trained Transformer Language Models and first released in metaseq's repository on May 3rd 2022 by Meta AI. Disclaimer: The team releasing OPT wrote an official model card, which is available in Appendix D of the paper. Content from this model card has been written by the Hugging Face team. To quote the first two paragraphs of the official paper OPT was predominantly pretrained with English text, but a small amount of non-English data is still present within the training corpus via CommonCrawl. The model was pretrained using a causal language modeling (CLM) objective. OPT belongs to the same family of decoder-only models like GPT-3. As such, it was…

Open weights other 2,048 tokens transformers

Model · Text generation

Ornith-1.5-9B-GGUF

Ornith

Chirp Chirp! We are introducing Ornith-1.5, a major step toward building foundation models through end-to-end self-improvement. Ornith-1.5 extends Ornith-1.0 (which was developed on top of Qwen3.5 and Gemma4 with additional continued pretraining, mid-training, and post-training) by expanding the self-improvement loop from scaffold and rollout optimization to jointly optimizing task generation, scaffold construction, and solution rollouts. Rather than relying on a fixed set of human-curated tasks and manually designed harnesses, Ornith-1.5 continuously generates new training tasks, discovers effective strategies for solving them, and improves the policy through reinforcement learning. For…

Open weights mit transformers

Model · Text generation

Ornith-1.5-35B-A3B-GGUF

Ornith

Chirp Chirp! We are introducing Ornith-1.5, a major step toward building foundation models through end-to-end self-improvement. Ornith-1.5 extends Ornith-1.0 (which was developed on top of Qwen3.5 and Gemma4 with additional continued pretraining, mid-training, and post-training) by expanding the self-improvement loop from scaffold and rollout optimization to jointly optimizing task generation, scaffold construction, and solution rollouts. Rather than relying on a fixed set of human-curated tasks and manually designed harnesses, Ornith-1.5 continuously generates new training tasks, discovers effective strategies for solving them, and improves the policy through reinforcement learning. For…

Open weights mit transformers

Model · Text generation

Ternary-Bonsai-2-27B-gguf

Prism ML

Full 27B-class reasoning in ternary transformer weights, for llama.cpp (CUDA, Metal, CPU) - \~5.9 GB language model (down from \~54 GB FP16) — full 27B-class reasoning on a standard laptop or a single GPU - 98.2% of FP16 intelligence retained: 84.78 average across 14 thinking-mode benchmarks — far above the conventional IQ2XXS build (72.59) at about 82% of its footprint, and within 0.4 points of UD-Q4KXL at three times the footprint - Retains thinking, reasoning, and agentic behavior deep in the sub-4-bit regime, where conventional low-bit representations collapse: math within half a point of full precision (96.57), coding level with the baseline (89.42), agentic tool calling at 74.92…

Open weights apache-2.0 llama.cpp

Uncensored Qwen3.8-27B, published as GGUF quantizations with the multi token prediction (MTP) head retained and verified. Refusal behaviour has been substantially reduced, not eliminated. See Measured behaviour for the numbers. Capabilities, training data, and architecture are otherwise unchanged. - Refusal directions removed with Heretic, which co minimizes refusal count against KL divergence from the base model. No handwritten refusal removal code, no finetuning, no additional training data. - Abliteration runs at bf16 (no 4 bit quantization). the resulting LoRA is merged into the bf16 base, so the published weights are not a quantized round trip. - mtp. tensors are copied verbatim from…

Open weights apache-2.0 llama.cpp

Model · Text generation

Ornith-1.0-9B-GGUF

Ornith

Aloha! Today, we are releasing Ornith-1.0, a self-improving family of open-source models for agentic coding. This model card documents Ornith-1.0-9B, the most lightweight member of the Ornith family, designed for efficient single-GPU deployment. Ornith-1.0-9B is a dense ~9B model (≈19 GB in bf16), so it serves comfortably on a single 80GB GPU. The recipes below stand up an OpenAI-compatible server; add --tensor-parallel-size / --tp if you want to shard across more GPUs. For a quick local test (or to script offline generation), load the model directly with Transformers. Make sure you have a recent release installed — see the Transformers installation guide; Ornith-1.0-9B requires…

Open weights mit transformers