Skip to page content
SAVRN
Search Plan a project

Open-weight model · Text generation

DeepSeek-V4.1-Flash-GGUF

by Solstice-AI Solstice-AI/DeepSeek-V4.1-Flash-GGUF

DeepSeek-V4.1-Flash-GGUF is an open-weight model for text generation from Solstice-AI, released under MIT License. Its published files total 1.3 TB. It draws 3k downloads a month.

llama.cpp GGUF of deepseek-ai/DeepSeek-V4.1-Flash. This is V4.1-Flash (DeepseekV41ForCausalLM), a causal decoder with engram n-gram lookup tables, hyper-connections and sparse attention. It is not V4-Flash-0731.

Parameters—
Context—
Weights1.3 TB
Licensemit
AccessOpen weights
Monthly Downloads3k

Model Card

By Solstice-AI, published under mit, revision 8bee57633be1.

llama.cpp GGUF of deepseek-ai/DeepSeek-V4.1-Flash. This is V4.1-Flash (DeepseekV41ForCausalLM), a causal decoder with engram n-gram lookup tables, hyper-connections and sparse attention. It is not V4-Flash-0731. How to build the engine, serve it, and the gotchas, plus the current status: These files do not run on upstream llama.cpp yet. Conversion works and is open as ggml-org/llama.cpp#28696. The runtime is in progress on the runtime/deepseek41 branch of vcruz305/llama.cpp: the loader, the engram tables and the hyper-connections work and are verified against the reference implementation, and the sparse attention is the remaining piece. Weights land here as each rung finishes. Anything…

Read Solstice-AI's full model card

llama.cpp GGUF of deepseek-ai/DeepSeek-V4.1-Flash.

This is V4.1-Flash (DeepseekV41ForCausalLM), a causal decoder with engram n-gram lookup tables, hyper-connections and sparse attention. It is not V4-Flash-0731.

Recipe

How to build the engine, serve it, and the gotchas, plus the current status: vcruz305/DeepSeek-V4.1-Flash-GGUF-DGX-Spark-recipe

Status

These files do not run on upstream llama.cpp yet. Conversion works and is open as ggml-org/llama.cpp#28696. The runtime is in progress on the runtime/deepseek41 branch of vcruz305/llama.cpp: the loader, the engram tables and the hyper-connections work and are verified against the reference implementation, and the sparse attention is the remaining piece.

Weights land here as each rung finishes. Anything converted before 2026-09-10 carries general.architecture = deepseek4 and is being redone as deepseek41.

The architecture string is deepseek41, following llama.cpp's habit of dropping the _v (deepseek_v2 became deepseek2, deepseek_v3.2 became deepseek32).

2026-09-11 fix: the 4 Engram KV keys (head_count, key_length, max_ngram_size, layer_ids) were written with a hardcoded deepseek4.engram.* prefix instead of resolving {arch}.engram.* like every other arch-scoped key in the file. general.architecture and all 38 other arch-scoped keys were already correct (deepseek41.*); only these 4 were wrong, which would have made the runtime/deepseek41 loader fail to find Engram config on an otherwise loadable file. Fixed in place via a KV-only rewrite (tensor data untouched, verified byte-identical by SHA-256) on all five quant rungs' first shard, where GGUF split files store metadata. Confirmed live: all five now read deepseek41.engram.*.

Files

Ladder in order: Q2_K, Q3_K_M, Q4_K_M. Measured tensor payload:

File Quant Bytes GiB
DeepSeek-V4.1-Flash-Q2_K.gguf Q2_K 264,514,761,248 246.3
DeepSeek-V4.1-Flash-Q3_K_M.gguf Q3_K_M 347,270,954,112 323.4
DeepSeek-V4.1-Flash-Q4_K_M.gguf Q4_K_M pending

Split into parts, since each exceeds the Hub's single file limit.

Q5_K_M is skipped unless asked for. The routed experts arrive as MXFP4 at 4.25 bpw, so higher rungs move parts of the mixture up rather than down: Q3_K_M already lands at 0.684 of the Q8_0 staging file, and Q5_K_M would be close enough to Q8_0 to be poor value.

Most of the file is the two engram tables, roughly 196.6B parameters between them. They follow the rung, 99,611 to 40,284 MiB each between q8_0 and q3_K.

Apache/MIT from upstream. Credit: DeepSeek. GGUF pack: Victor Cruz (vcruz305).

Identity and Version

Repository
Solstice-AI/DeepSeek-V4.1-Flash-GGUF
Publisher
Solstice-AI
Task
Text generation
Modality
Text
Library
gguf
Parameters
Not stated by the source
Languages
Not stated by the source
Revision
8bee57633be10f5ab9da819bcd2c5e6d5fd0a6c6
First published
2026-09-12
Last updated
2026-10-15

Files and Weights

37 files, 1.3 TB in total. The weights are 30 files totalling 1.3 TB in gguf.

Weights30 files · 1.3 TB
Configuration2 files · 40.9 KB
Documentation3 files · 7.5 KB
Other1 file · 33.9 KB
Repository1 file · 4.8 KB
Every file
FileTypeSizeSHA-256
DeepSeek-V4.1-Flash-Q3_K_M-00001-of-00009.ggufWeights8.0 GB 6499c20b172f
DeepSeek-V4.1-Flash-Q3_K_M-00002-of-00009.ggufWeights42.3 GB eb1bc512e478
DeepSeek-V4.1-Flash-Q3_K_M-00003-of-00009.ggufWeights44.2 GB 65e6fed86579
DeepSeek-V4.1-Flash-Q3_K_M-00004-of-00009.ggufWeights41.1 GB 3ed43f59a734
DeepSeek-V4.1-Flash-Q3_K_M-00005-of-00009.ggufWeights44.9 GB 9be50bb50273
DeepSeek-V4.1-Flash-Q3_K_M-00006-of-00009.ggufWeights43.1 GB 433b4362bb2f
DeepSeek-V4.1-Flash-Q3_K_M-00007-of-00009.ggufWeights43.6 GB bc5f9a0bde11
DeepSeek-V4.1-Flash-Q3_K_M-00008-of-00009.ggufWeights43.7 GB e6b08013c406
DeepSeek-V4.1-Flash-Q3_K_M-00009-of-00009.ggufWeights36.5 GB c069f939d796
DeepSeek-V4.1-Flash-Q4_K_M-00001-of-00011.ggufWeights9.9 GB aa0ef0b26baa
DeepSeek-V4.1-Flash-Q4_K_M-00002-of-00011.ggufWeights55.3 GB 0f7e076a5314
DeepSeek-V4.1-Flash-Q4_K_M-00003-of-00011.ggufWeights43.5 GB eaf7000aa1ee
DeepSeek-V4.1-Flash-Q4_K_M-00004-of-00011.ggufWeights43.6 GB 14d9641d478a
DeepSeek-V4.1-Flash-Q4_K_M-00005-of-00011.ggufWeights21.8 GB 5c0e4d0e120f
DeepSeek-V4.1-Flash-Q4_K_M-00006-of-00011.ggufWeights55.3 GB 56e2de3c9d3d
DeepSeek-V4.1-Flash-Q4_K_M-00007-of-00011.ggufWeights43.7 GB 656e0636bc9b
DeepSeek-V4.1-Flash-Q4_K_M-00008-of-00011.ggufWeights45.0 GB e3ec8118206d
DeepSeek-V4.1-Flash-Q4_K_M-00009-of-00011.ggufWeights43.7 GB 4f20e2cf9d3d
DeepSeek-V4.1-Flash-Q4_K_M-00010-of-00011.ggufWeights44.8 GB 4c3c9101d61d
DeepSeek-V4.1-Flash-Q4_K_M-00011-of-00011.ggufWeights38.2 GB 1f7ed637779d
DeepSeek-V4.1-Flash-Q8_0-00001-of-00010.ggufWeights43.3 GB 167304a8d112
DeepSeek-V4.1-Flash-Q8_0-00002-of-00010.ggufWeights43.3 GB d9f95f3ec801
DeepSeek-V4.1-Flash-Q8_0-00003-of-00010.ggufWeights43.3 GB c53687cc23e2
DeepSeek-V4.1-Flash-Q8_0-00004-of-00010.ggufWeights43.3 GB ba84c194c41f
DeepSeek-V4.1-Flash-Q8_0-00005-of-00010.ggufWeights43.3 GB 66fdac198238
DeepSeek-V4.1-Flash-Q8_0-00006-of-00010.ggufWeights43.3 GB 19a2b0e85cce
DeepSeek-V4.1-Flash-Q8_0-00007-of-00010.ggufWeights28.9 GB f04e8d27188e
DeepSeek-V4.1-Flash-Q8_0-00008-of-00010.ggufWeights104.4 GB dc05657987ac
DeepSeek-V4.1-Flash-Q8_0-00009-of-00010.ggufWeights104.5 GB f8fe6989ba59
DeepSeek-V4.1-Flash-Q8_0-00010-of-00010.ggufWeights10.3 GB f7f00c58e282
llama.cpp/patches/fix_gguf_engram_kv.pyConfiguration10.0 KB —
llama.cpp/patches/patch_llamacpp_v41.pyConfiguration30.9 KB —
.probe.mdDocumentation58 B —
README.mdDocumentation3.1 KB —
llama.cpp/patches/README.mdDocumentation4.3 KB —
chat_template.jinjaOther33.9 KB —
.gitattributesRepository4.8 KB —

License and Download

License
mit
Access
Open weights, no gate
Download size
1.3 TB
Download from Solstice-AI

Released by Solstice-AI through its official repository on Hugging Face. Read the license.

Built From

Memory Requirements

PrecisionWeights in memory
As published1.3 TB

Weights only, from the published parameter count; the key-value cache and runtime add to this.

Questions About DeepSeek-V4.1-Flash-GGUF

Can I use DeepSeek-V4.1-Flash-GGUF commercially?

Yes. DeepSeek-V4.1-Flash-GGUF is released under MIT License. The MIT License is a short permissive license. It permits commercial use, modification and redistribution, provided the copyright notice and permission notice are included.

Similar Models

Model · Text generation

opt-125m

AI at Meta

OPT was first introduced in Open Pre-trained Transformer Language Models and first released in metaseq's repository on May 3rd 2022 by Meta AI. Disclaimer: The team releasing OPT wrote an official model card, which is available in Appendix D of the paper. Content from this model card has been written by the Hugging Face team. To quote the first two paragraphs of the official paper OPT was predominantly pretrained with English text, but a small amount of non-English data is still present within the training corpus via CommonCrawl. The model was pretrained using a causal language modeling (CLM) objective. OPT belongs to the same family of decoder-only models like GPT-3. As such, it was…

Open weights other 2,048 tokens transformers

Model · Text generation

Ornith-1.5-9B-GGUF

Ornith

Chirp Chirp! We are introducing Ornith-1.5, a major step toward building foundation models through end-to-end self-improvement. Ornith-1.5 extends Ornith-1.0 (which was developed on top of Qwen3.5 and Gemma4 with additional continued pretraining, mid-training, and post-training) by expanding the self-improvement loop from scaffold and rollout optimization to jointly optimizing task generation, scaffold construction, and solution rollouts. Rather than relying on a fixed set of human-curated tasks and manually designed harnesses, Ornith-1.5 continuously generates new training tasks, discovers effective strategies for solving them, and improves the policy through reinforcement learning. For…

Open weights mit transformers

Model · Text generation

Ternary-Bonsai-2-27B-gguf

Prism ML

Full 27B-class reasoning in ternary transformer weights, for llama.cpp (CUDA, Metal, CPU) - \~5.9 GB language model (down from \~54 GB FP16) — full 27B-class reasoning on a standard laptop or a single GPU - 98.2% of FP16 intelligence retained: 84.78 average across 14 thinking-mode benchmarks — far above the conventional IQ2XXS build (72.59) at about 82% of its footprint, and within 0.4 points of UD-Q4KXL at three times the footprint - Retains thinking, reasoning, and agentic behavior deep in the sub-4-bit regime, where conventional low-bit representations collapse: math within half a point of full precision (96.57), coding level with the baseline (89.42), agentic tool calling at 74.92…

Open weights apache-2.0 llama.cpp

Model · Text generation

Ornith-1.5-35B-A3B-GGUF

Ornith

Chirp Chirp! We are introducing Ornith-1.5, a major step toward building foundation models through end-to-end self-improvement. Ornith-1.5 extends Ornith-1.0 (which was developed on top of Qwen3.5 and Gemma4 with additional continued pretraining, mid-training, and post-training) by expanding the self-improvement loop from scaffold and rollout optimization to jointly optimizing task generation, scaffold construction, and solution rollouts. Rather than relying on a fixed set of human-curated tasks and manually designed harnesses, Ornith-1.5 continuously generates new training tasks, discovers effective strategies for solving them, and improves the policy through reinforcement learning. For…

Open weights mit transformers

Fine-tune Qwen3 (14B) for free using our Google Colab notebook! - Read our Blog about Qwen3 support: unsloth.ai/blog/qwen3 - View the rest of our notebooks in our docs here. Qwen3-Coder is available in multiple sizes. Today, we're excited to introduce Qwen3-Coder-30B-A3B-Instruct. This streamlined model maintains impressive performance and efficiency, featuring the following key enhancements: - Significant Performance among open models on Agentic Coding, Agentic Browser-Use, and other foundational coding tasks. - Long-context Capabilities with native support for 256K tokens, extendable up to 1M tokens using Yarn, optimized for repository-scale understanding. - Agentic Coding supporting for…

Open weights apache-2.0 transformers

Uncensored Qwen3.8-27B, published as GGUF quantizations with the multi token prediction (MTP) head retained and verified. Refusal behaviour has been substantially reduced, not eliminated. See Measured behaviour for the numbers. Capabilities, training data, and architecture are otherwise unchanged. - Refusal directions removed with Heretic, which co minimizes refusal count against KL divergence from the base model. No handwritten refusal removal code, no finetuning, no additional training data. - Abliteration runs at bf16 (no 4 bit quantization). the resulting LoRA is merged into the bf16 base, so the published weights are not a quantized round trip. - mtp. tensors are copied verbatim from…

Open weights apache-2.0 llama.cpp