IntDim-E 50% pruned openai/gpt-oss-120b
This checkpoint was structurally pruned with the released Less-is-MoE
mean-absolute-gradient method. It removes exactly 50% of routed-expert FFN
neurons using 64 calibration samples from the gpqa_main configuration of
Idavidrein/gpqa revision
633f5ee89ab8ad4522a9f850766b73f62147ffdd. The released loader settings are preserved:
train, Question plus shuffled choices, Explanation, selection_seed=1234,
BF16, and no optimizer step. The samples are full length: no tokenizer
max_length, truncation, or padding. The longest input for this tokenizer is
1,511 tokens. The source MXFP4 checkpoint was explicitly dequantized to BF16 before scoring and pruning.
The source-row selection hash is
790c4c22309def44542965fdde7c5f38f1d8e354602640cfb31518134b8d92e6 and the model-specific token-file hash
is 0c4117b307a807e731a987d9192ee61d7c8ade16c31eb0007bbe400629662080. Full export and zero-mask
equivalence metadata are in experiment-export.json. The exact calibration and
held-out test rows are in the private dataset
jayzou3773/less-is-moe-gpqa-main-calibration-64 revision
b9596e85179b3017f77ba1436a5d2e61b6a61a5b, following GPQA's access terms.
Inference requires stock vLLM from the unified Less-is-MoE GPU image. IntDim-E
has one uniform expert width. IntDim-L/G retain the routed MoE topology and
store compact per-expert widths in config.json.
