Google publishes the QAT Q40 model google/gemma-4-E4B-it-qat-q40-gguf as GGUF, but its multi-token-prediction (MTP) assistant only as safetensors There was no GGUF MTP head for the QAT GGUF, so this repository is that assistant converted to GGUF, nothing else: no training or fine-tuning. Use it together with google/gemma-4-E4B-it-qat-q40-gguf for speculative decoding in llama.cpp. The Google model card asks for exactly this pairing: "When using multi-token prediction (speculative decoding) with an assistant model alongside a QAT target model, the assistant model must also be a QAT checkpoint with the same precision." llama.cpp at commit 0c1e570 (Gemma4AssistantForCausalLM → GGUF…
Independent publisher
Ensky0
ensky0
Models in Library5
Datasets in Library0
Models on Hugging Face5
Followers—
Compare the published evidence
This profile connects the 5 model and dataset records shown below to their upstream cards and sources. The library counts describe SAVRN's coverage, rather than this publisher's entire output.
Published tasks: Text generation.
Reported licenses: apache-2.0. Open a record to review its specific license and conditions.
Compare model specifications, source dates, and hardware estimates on the individual records. Publisher identity verification is separate from a model's quality, deployment readiness, or suitability for your work.
Models
Google publishes the QAT Q40 model google/gemma-4-E2B-it-qat-q40-gguf as GGUF, but its multi-token-prediction (MTP) assistant only as safetensors There was no GGUF MTP head for the QAT GGUF, so this repository is that assistant converted to GGUF, nothing else: no training or fine-tuning. Use it together with google/gemma-4-E2B-it-qat-q40-gguf for speculative decoding in llama.cpp. The Google model card asks for exactly this pairing: "When using multi-token prediction (speculative decoding) with an assistant model alongside a QAT target model, the assistant model must also be a QAT checkpoint with the same precision." llama.cpp at commit 0c1e570 (Gemma4AssistantForCausalLM → GGUF…
Google publishes the QAT Q40 model google/gemma-4-31B-it-qat-q40-gguf as GGUF, but its multi-token-prediction (MTP) assistant only as safetensors There was no GGUF MTP head for the QAT GGUF, so this repository is that assistant converted to GGUF, nothing else: no training or fine-tuning. Use it together with google/gemma-4-31B-it-qat-q40-gguf for speculative decoding in llama.cpp. The Google model card asks for exactly this pairing: "When using multi-token prediction (speculative decoding) with an assistant model alongside a QAT target model, the assistant model must also be a QAT checkpoint with the same precision." llama.cpp at commit 0c1e570 (Gemma4AssistantForCausalLM → GGUF…
Google publishes the QAT Q40 model google/gemma-4-26B-A4B-it-qat-q40-gguf as GGUF, but its multi-token-prediction (MTP) assistant only as safetensors There was no GGUF MTP head for the QAT GGUF, so this repository is that assistant converted to GGUF, nothing else: no training or fine-tuning. Use it together with google/gemma-4-26B-A4B-it-qat-q40-gguf for speculative decoding in llama.cpp. The Google model card asks for exactly this pairing: "When using multi-token prediction (speculative decoding) with an assistant model alongside a QAT target model, the assistant model must also be a QAT checkpoint with the same precision." llama.cpp at commit 0c1e570 (Gemma4AssistantForCausalLM → GGUF…
Google publishes the QAT Q40 model google/gemma-4-12B-it-qat-q40-gguf as GGUF, but its multi-token-prediction (MTP) assistant only as safetensors There was no GGUF MTP head for the QAT GGUF, so this repository is that assistant converted to GGUF, nothing else: no training or fine-tuning. Use it together with google/gemma-4-12B-it-qat-q40-gguf for speculative decoding in llama.cpp. The Google model card asks for exactly this pairing: "When using multi-token prediction (speculative decoding) with an assistant model alongside a QAT target model, the assistant model must also be a QAT checkpoint with the same precision." llama.cpp at commit 0c1e570 (Gemma4UnifiedAssistantForCausalLM → GGUF…