Run Qwen 3.8 Flash Next heretic-2 locally on two RTX 3090 24 GB GPUs and 128 GB RAM. Start with the GitHub quickstart and pinned runtime; the weights require its custom vLLM overlay. This checkpoint is the heretic-2 reassembly of the (AutoRound W4A16) instead of Intel's stock AutoRound target. 1,860 tok/s prefill · 89.1 tok/s decode · 2× RTX 3090 + 128 GB RAM decode after 131,072 input tokens. Each generates 2,048 tokens. The latest experimental runtime reaches the first token in 139.8 seconds with 260,096 input tokens, then generates 2,048 tokens at 86.2 tok/s. That fills the native 262,144-token window. The full request takes 163.6 seconds. The wait fell from 214.5 to 139.8 seconds…
Independent publisher
FL
densohax
Models in Library1
Datasets in Library0
Models on Hugging Face1
Followers—
Compare the published evidence
This profile connects the 1 model and dataset record shown below to their upstream cards and sources. The library counts describe SAVRN's coverage, rather than this publisher's entire output.
Published tasks: Text generation.
Reported licenses: other. Open a record to review its specific license and conditions.
Compare model specifications, source dates, and hardware estimates on the individual records. Publisher identity verification is separate from a model's quality, deployment readiness, or suitability for your work.