This repository contains GGUF quantizations of Hermes3.6-35B-A3B-Uncensored-Genesis-Final-Q8KP produced with a custom, measurement-driven requantizer developed as a personal study of quantization formats for MoE models. Unlike a standard one-format quantization, each file here uses a per-tensor blend of formats (Q4K, Q6K, Q80, NVFP4), selected by measuring the element-wise quantization error of every tensor individually and applying a sensitivity policy derived from controlled perplexity experiments. All files were requantized directly from the Q80 source checkpoint. No F16/BF16 intermediate was produced; source tensors are dequantized in memory only. (Now working on imatrix improvement and…
Independent publisher
ST
Dargoth
Agent pipelines, local inference, quantization
Models in Library1
Datasets in Library0
Models on Hugging Face1
Followers—
Compare the published evidence
This profile connects the 1 model and dataset record shown below to their upstream cards and sources. The library counts describe SAVRN's coverage, rather than this publisher's entire output.
Reported licenses: apache-2.0. Open a record to review its specific license and conditions.
Compare model specifications, source dates, and hardware estimates on the individual records. Publisher identity verification is separate from a model's quality, deployment readiness, or suitability for your work.