Qwen3.8-27B in MXFP4 for one AMD Radeon AI PRO R9700 (32 GB). Needs GGZ14's vLLM-Radiance fork plus our patches (quantmethod: paroquantmxfp4; stock vLLM and transformers can't load it). Setup: github.com/mtstanfield/vllm-mxfp4, branch r9700-tp1, R9700-HANDOFF.md. MTP speculative decoding with 4 draft tokens. Full BetterBench report and setup: R9700-HANDOFF.md on the branch. pairwise rotations per 128-channel group, retrained for the MXFP4 grid from z-lab's int4 rotations. - GPTQ onto the MXFP4 grid in the rotated basis, with per-block scale search. - lmhead fp8 per-channel, embedtokens fp8 per-row, MTP head fp8. extras/qwen38-paro-v2-mtp-gptq-a05.pt is the MTP head requantized to MXFP4 with…
Independent publisher
Ms
MisterSnrub
Models in Library1
Datasets in Library0
Models on Hugging Face2
Followers—
Compare the published evidence
This profile connects the 1 model and dataset record shown below to their upstream cards and sources. The library counts describe SAVRN's coverage, rather than this publisher's entire output.
Published tasks: Image and text to text.
Reported licenses: apache-2.0. Open a record to review its specific license and conditions.
Compare model specifications, source dates, and hardware estimates on the individual records. Publisher identity verification is separate from a model's quality, deployment readiness, or suitability for your work.