SAVRN
Search Contact SAVRN

Independent publisher

DavidB

Davd-b01

Models in Library1
Datasets in Library0
Models on Hugging Face31
Followers4

Models

Model · Text generation

qwen38-40b-prune

DavidB

One upstream MoE, six generations of masks, one bit-exact surgery, a rebuilt factual memory, and a three-stage post-training (SFT → SimPO → RLVR) — with every error I made and every idea I falsified along the way. This repository is the complete technical record of the project: the activation-instrumentation artifacts, the mask-generation methodology, the surgery code, the PLE (n-gram memory) rebuild, the trainers, and the full lab notebook. The champion weights live in sibling repos What I set out to do: take Qwen3.8-Flash-Next — an ~180B-class MoE (~130B of core network + 51B of n-gram memory table + 4B MTP) — and cut it by 75% of its experts (512 → 128) while conserving the maximum…

Open weights apache-2.0 transformers