Open-weight model
where-quantization-hurts-reasoning
by Sehyun Park sehyun734/where-quantization-hurts-reasoning
where-quantization-hurts-reasoning is an open-weight model from Sehyun Park. Its published files total 35.3 GB.
Parameters—
Context—
Weights34.7 GB
License—
AccessOpen weights
Monthly Downloads—
Model Card
The publisher has not written a card for this model.
Identity and Version
- Repository
- sehyun734/where-quantization-hurts-reasoning
- Publisher
- Sehyun Park
- Task
- Not stated by the source
- Modality
- Other
- Library
- Not stated by the source
- Parameters
- Not stated by the source
- Languages
- Not stated by the source
- Revision
- 5f3bde3be1a20a5c95bbfc3e18a3cd124a538901
- First published
- 2026-10-09
- Last updated
- 2026-10-15
Files and Weights
112 files, 35.3 GB in total. The weights are 28 files totalling 34.7 GB in safetensors.
Weights28 files · 34.7 GB
Configuration83 files · 658.7 MB
Repository1 file · 9.5 KB
Every file
| File | Type | Size | SHA-256 |
|---|---|---|---|
| calibration/Qwen3-0.6B/num_samples=128/outputs.safetensors | Weights | 2.0 MB | 3a3af5a8f131 |
| calibration/Qwen3-0.6B/num_samples=2048/outputs.safetensors | Weights | 92.4 MB | b3bc29d2eaa8 |
| calibration/Qwen3-1.7B/num_samples=128/outputs.safetensors | Weights | 2.1 MB | 2d3e62afffe4 |
| calibration/Qwen3-1.7B/num_samples=2048/outputs.safetensors | Weights | 98.5 MB | 8540491b970e |
| gptq/Qwen3-0.6B/num_bits=4,group_size=128,num_samples=128/grid.safetensors | Weights | 27.6 MB | 6c80ba72af8f |
| gptq/Qwen3-0.6B/num_bits=4,group_size=128,num_samples=128/model.safetensors | Weights | 1.2 GB | 36648eea8270 |
| gptq/Qwen3-1.7B/num_bits=4,group_size=128,num_samples=128/grid.safetensors | Weights | 88.1 MB | 13410c260bc3 |
| gptq/Qwen3-1.7B/num_bits=4,group_size=128,num_samples=128/model.safetensors | Weights | 3.4 GB | 1ba1a406d3e1 |
| merge/gptq/Qwen3-0.6B/num_bits=4,group_size=128,num_samples=128/model.safetensors | Weights | 2.4 GB | 83aa9acdea78 |
| merge/gptq/Qwen3-1.7B/num_bits=4,group_size=128,num_samples=128/model.safetensors | Weights | 6.9 GB | b28f41a14c56 |
| merge/mxfp4/Qwen3-1.7B/group_size=32/model.safetensors | Weights | 6.9 GB | 0a38fedfb781 |
| mxfp4/Qwen3-1.7B/group_size=32/grid.safetensors | Weights | 176.2 MB | e25873d821f9 |
| mxfp4/Qwen3-1.7B/group_size=32/model.safetensors | Weights | 3.4 GB | ea71a2a3c814 |
| qat/Qwen3-0.6B/num_bits=4,group_size=128,num_samples=128,qat_num_samples=2048,high_entropy_ratio=0.2,high_entropy_weight=1,learning_rate=0.0001,num_epochs=1/grid.safetensors | Weights | 27.6 MB | 6c80ba72af8f |
| qat/Qwen3-0.6B/num_bits=4,group_size=128,num_samples=128,qat_num_samples=2048,high_entropy_ratio=0.2,high_entropy_weight=1,learning_rate=0.0001,num_epochs=1/model.safetensors | Weights | 1.2 GB | 77ae481ab54f |
| qat/Qwen3-0.6B/num_bits=4,group_size=128,num_samples=128,qat_num_samples=2048,high_entropy_ratio=0.2,high_entropy_weight=3,learning_rate=0.0001,num_epochs=1/grid.safetensors | Weights | 27.6 MB | 6c80ba72af8f |
| qat/Qwen3-0.6B/num_bits=4,group_size=128,num_samples=128,qat_num_samples=2048,high_entropy_ratio=0.2,high_entropy_weight=3,learning_rate=0.0001,num_epochs=1/model.safetensors | Weights | 1.2 GB | b5fdccc9791d |
| qat/Qwen3-1.7B/num_bits=4,group_size=128,num_samples=128,qat_num_samples=2048,high_entropy_ratio=0.2,high_entropy_weight=1,learning_rate=0.0001,num_epochs=1/grid.safetensors | Weights | 88.1 MB | 13410c260bc3 |
| qat/Qwen3-1.7B/num_bits=4,group_size=128,num_samples=128,qat_num_samples=2048,high_entropy_ratio=0.2,high_entropy_weight=1,learning_rate=0.0001,num_epochs=1/model.safetensors | Weights | 3.4 GB | a503d2fbfb55 |
| qat/Qwen3-1.7B/num_bits=4,group_size=128,num_samples=128,qat_num_samples=2048,high_entropy_ratio=0.2,high_entropy_weight=3,learning_rate=0.0001,num_epochs=1/grid.safetensors | Weights | 88.1 MB | 13410c260bc3 |
| qat/Qwen3-1.7B/num_bits=4,group_size=128,num_samples=128,qat_num_samples=2048,high_entropy_ratio=0.2,high_entropy_weight=3,learning_rate=0.0001,num_epochs=1/model.safetensors | Weights | 3.4 GB | 8eac504fbc0d |
| teacher_forcing/gptq/Qwen3-0.6B/num_bits=4,group_size=128,num_samples=128/seed=0.safetensors | Weights | 50.8 MB | afeb0204b2a6 |
| teacher_forcing/gptq/Qwen3-1.7B/num_bits=4,group_size=128,num_samples=128/seed=0.safetensors | Weights | 76.1 MB | 6b5a6b2fff6b |
| teacher_forcing/mxfp4/Qwen3-1.7B/group_size=32/seed=0.safetensors | Weights | 76.1 MB | 23d969803ecf |
| teacher_forcing/qat/Qwen3-0.6B/num_bits=4,group_size=128,num_samples=128,qat_num_samples=2048,high_entropy_ratio=0.2,high_entropy_weight=1,learning_rate=0.0001,num_epochs=1/seed=0.safetensors | Weights | 50.8 MB | 126f1601f51c |
| teacher_forcing/qat/Qwen3-0.6B/num_bits=4,group_size=128,num_samples=128,qat_num_samples=2048,high_entropy_ratio=0.2,high_entropy_weight=3,learning_rate=0.0001,num_epochs=1/seed=0.safetensors | Weights | 50.8 MB | 9bbbbd95073d |
| teacher_forcing/qat/Qwen3-1.7B/num_bits=4,group_size=128,num_samples=128,qat_num_samples=2048,high_entropy_ratio=0.2,high_entropy_weight=1,learning_rate=0.0001,num_epochs=1/seed=0.safetensors | Weights | 76.1 MB | 47eea1d14734 |
| teacher_forcing/qat/Qwen3-1.7B/num_bits=4,group_size=128,num_samples=128,qat_num_samples=2048,high_entropy_ratio=0.2,high_entropy_weight=3,learning_rate=0.0001,num_epochs=1/seed=0.safetensors | Weights | 76.1 MB | 42d02fe278ea |
| calibration/Qwen3-0.6B/num_samples=128/rows.json | Configuration | 847.8 KB | — |
| calibration/Qwen3-0.6B/num_samples=2048/rows.json | Configuration | 37.1 MB | be3abcc7e28d |
| calibration/Qwen3-1.7B/num_samples=128/rows.json | Configuration | 853.8 KB | — |
| calibration/Qwen3-1.7B/num_samples=2048/rows.json | Configuration | 39.1 MB | c31c9d3182d3 |
| gptq/Qwen3-0.6B/num_bits=4,group_size=128,num_samples=128/config.json | Configuration | 1.4 KB | — |
| gptq/Qwen3-0.6B/num_bits=4,group_size=128,num_samples=128/generation_config.json | Configuration | 214 B | — |
| gptq/Qwen3-1.7B/num_bits=4,group_size=128,num_samples=128/config.json | Configuration | 1.4 KB | — |
| gptq/Qwen3-1.7B/num_bits=4,group_size=128,num_samples=128/generation_config.json | Configuration | 214 B | — |
| math500/bf16/Qwen3-0.6B/seed=0.json | Configuration | 8.9 MB | — |
| math500/bf16/Qwen3-0.6B/seed=1.json | Configuration | 8.8 MB | — |
| math500/bf16/Qwen3-0.6B/seed=2.json | Configuration | 8.9 MB | — |
| math500/bf16/Qwen3-1.7B/seed=0.json | Configuration | 8.5 MB | — |
| math500/bf16/Qwen3-1.7B/seed=1.json | Configuration | 8.3 MB | — |
| math500/bf16/Qwen3-1.7B/seed=2.json | Configuration | 8.7 MB | — |
| math500/gptq/Qwen3-0.6B/num_bits=4,group_size=128,num_samples=128/seed=0.json | Configuration | 11.3 MB | 3a735c4a2df5 |
| math500/gptq/Qwen3-0.6B/num_bits=4,group_size=128,num_samples=128/seed=1.json | Configuration | 11.3 MB | 716c27be5f03 |
| math500/gptq/Qwen3-0.6B/num_bits=4,group_size=128,num_samples=128/seed=2.json | Configuration | 10.7 MB | 305c7602f585 |
| math500/gptq/Qwen3-1.7B/num_bits=4,group_size=128,num_samples=128/seed=0.json | Configuration | 10.4 MB | — |
| math500/gptq/Qwen3-1.7B/num_bits=4,group_size=128,num_samples=128/seed=1.json | Configuration | 10.6 MB | f3157b9cf938 |
| math500/gptq/Qwen3-1.7B/num_bits=4,group_size=128,num_samples=128/seed=2.json | Configuration | 10.6 MB | cf72b11751c7 |
| math500/mxfp4/Qwen3-1.7B/group_size=32/seed=0.json | Configuration | 9.8 MB | — |
| math500/mxfp4/Qwen3-1.7B/group_size=32/seed=1.json | Configuration | 9.8 MB | — |
| math500/mxfp4/Qwen3-1.7B/group_size=32/seed=2.json | Configuration | 9.6 MB | — |
| math500/qat/Qwen3-0.6B/num_bits=4,group_size=128,num_samples=128,qat_num_samples=2048,high_entropy_ratio=0.2,high_entropy_weight=1,learning_rate=0.0001,num_epochs=1/seed=0.json | Configuration | 9.7 MB | — |
| math500/qat/Qwen3-0.6B/num_bits=4,group_size=128,num_samples=128,qat_num_samples=2048,high_entropy_ratio=0.2,high_entropy_weight=1,learning_rate=0.0001,num_epochs=1/seed=1.json | Configuration | 10.6 MB | 1cdc046d6028 |
| math500/qat/Qwen3-0.6B/num_bits=4,group_size=128,num_samples=128,qat_num_samples=2048,high_entropy_ratio=0.2,high_entropy_weight=1,learning_rate=0.0001,num_epochs=1/seed=2.json | Configuration | 10.7 MB | 47042b121bed |
| math500/qat/Qwen3-0.6B/num_bits=4,group_size=128,num_samples=128,qat_num_samples=2048,high_entropy_ratio=0.2,high_entropy_weight=3,learning_rate=0.0001,num_epochs=1/seed=0.json | Configuration | 10.4 MB | — |
| math500/qat/Qwen3-0.6B/num_bits=4,group_size=128,num_samples=128,qat_num_samples=2048,high_entropy_ratio=0.2,high_entropy_weight=3,learning_rate=0.0001,num_epochs=1/seed=1.json | Configuration | 10.6 MB | 753d76d7582b |
| math500/qat/Qwen3-0.6B/num_bits=4,group_size=128,num_samples=128,qat_num_samples=2048,high_entropy_ratio=0.2,high_entropy_weight=3,learning_rate=0.0001,num_epochs=1/seed=2.json | Configuration | 10.5 MB | 5047532f0b75 |
| math500/qat/Qwen3-1.7B/num_bits=4,group_size=128,num_samples=128,qat_num_samples=2048,high_entropy_ratio=0.2,high_entropy_weight=1,learning_rate=0.0001,num_epochs=1/seed=0.json | Configuration | 8.9 MB | — |
| math500/qat/Qwen3-1.7B/num_bits=4,group_size=128,num_samples=128,qat_num_samples=2048,high_entropy_ratio=0.2,high_entropy_weight=1,learning_rate=0.0001,num_epochs=1/seed=1.json | Configuration | 9.5 MB | — |
| math500/qat/Qwen3-1.7B/num_bits=4,group_size=128,num_samples=128,qat_num_samples=2048,high_entropy_ratio=0.2,high_entropy_weight=1,learning_rate=0.0001,num_epochs=1/seed=2.json | Configuration | 9.2 MB | — |
| math500/qat/Qwen3-1.7B/num_bits=4,group_size=128,num_samples=128,qat_num_samples=2048,high_entropy_ratio=0.2,high_entropy_weight=3,learning_rate=0.0001,num_epochs=1/seed=0.json | Configuration | 8.7 MB | — |
| math500/qat/Qwen3-1.7B/num_bits=4,group_size=128,num_samples=128,qat_num_samples=2048,high_entropy_ratio=0.2,high_entropy_weight=3,learning_rate=0.0001,num_epochs=1/seed=1.json | Configuration | 8.7 MB | — |
| math500/qat/Qwen3-1.7B/num_bits=4,group_size=128,num_samples=128,qat_num_samples=2048,high_entropy_ratio=0.2,high_entropy_weight=3,learning_rate=0.0001,num_epochs=1/seed=2.json | Configuration | 9.0 MB | — |
| merge/gptq/Qwen3-0.6B/num_bits=4,group_size=128,num_samples=128/config.json | Configuration | 2.0 KB | — |
| merge/gptq/Qwen3-0.6B/num_bits=4,group_size=128,num_samples=128/generation_config.json | Configuration | 239 B | — |
| merge/gptq/Qwen3-1.7B/num_bits=4,group_size=128,num_samples=128/config.json | Configuration | 2.0 KB | — |
| merge/gptq/Qwen3-1.7B/num_bits=4,group_size=128,num_samples=128/generation_config.json | Configuration | 239 B | — |
| merge/mxfp4/Qwen3-1.7B/group_size=32/config.json | Configuration | 2.0 KB | — |
| merge/mxfp4/Qwen3-1.7B/group_size=32/generation_config.json | Configuration | 239 B | — |
| mxfp4/Qwen3-1.7B/group_size=32/config.json | Configuration | 1.4 KB | — |
| mxfp4/Qwen3-1.7B/group_size=32/generation_config.json | Configuration | 214 B | — |
| qat/Qwen3-0.6B/num_bits=4,group_size=128,num_samples=128,qat_num_samples=2048,high_entropy_ratio=0.2,high_entropy_weight=1,learning_rate=0.0001,num_epochs=1/config.json | Configuration | 1.4 KB | — |
| qat/Qwen3-0.6B/num_bits=4,group_size=128,num_samples=128,qat_num_samples=2048,high_entropy_ratio=0.2,high_entropy_weight=1,learning_rate=0.0001,num_epochs=1/generation_config.json | Configuration | 214 B | — |
| qat/Qwen3-0.6B/num_bits=4,group_size=128,num_samples=128,qat_num_samples=2048,high_entropy_ratio=0.2,high_entropy_weight=3,learning_rate=0.0001,num_epochs=1/config.json | Configuration | 1.4 KB | — |
| qat/Qwen3-0.6B/num_bits=4,group_size=128,num_samples=128,qat_num_samples=2048,high_entropy_ratio=0.2,high_entropy_weight=3,learning_rate=0.0001,num_epochs=1/generation_config.json | Configuration | 214 B | — |
| qat/Qwen3-1.7B/num_bits=4,group_size=128,num_samples=128,qat_num_samples=2048,high_entropy_ratio=0.2,high_entropy_weight=1,learning_rate=0.0001,num_epochs=1/config.json | Configuration | 1.4 KB | — |
| qat/Qwen3-1.7B/num_bits=4,group_size=128,num_samples=128,qat_num_samples=2048,high_entropy_ratio=0.2,high_entropy_weight=1,learning_rate=0.0001,num_epochs=1/generation_config.json | Configuration | 214 B | — |
| qat/Qwen3-1.7B/num_bits=4,group_size=128,num_samples=128,qat_num_samples=2048,high_entropy_ratio=0.2,high_entropy_weight=3,learning_rate=0.0001,num_epochs=1/config.json | Configuration | 1.4 KB | — |
| qat/Qwen3-1.7B/num_bits=4,group_size=128,num_samples=128,qat_num_samples=2048,high_entropy_ratio=0.2,high_entropy_weight=3,learning_rate=0.0001,num_epochs=1/generation_config.json | Configuration | 214 B | — |
| routing/gptq/Qwen3-0.6B/num_bits=4,group_size=128,num_samples=128,route_ratio=0.1,route=high/seed=0.json | Configuration | 10.5 MB | — |
| routing/gptq/Qwen3-0.6B/num_bits=4,group_size=128,num_samples=128,route_ratio=0.1,route=high/seed=1.json | Configuration | 9.7 MB | — |
| routing/gptq/Qwen3-0.6B/num_bits=4,group_size=128,num_samples=128,route_ratio=0.1,route=high/seed=2.json | Configuration | 9.8 MB | — |
| routing/gptq/Qwen3-0.6B/num_bits=4,group_size=128,num_samples=128,route_ratio=0.1,route=random/seed=0.json | Configuration | 10.2 MB | — |
| routing/gptq/Qwen3-0.6B/num_bits=4,group_size=128,num_samples=128,route_ratio=0.1,route=random/seed=1.json | Configuration | 10.7 MB | 29dfac8d5489 |
| routing/gptq/Qwen3-0.6B/num_bits=4,group_size=128,num_samples=128,route_ratio=0.1,route=random/seed=2.json | Configuration | 11.0 MB | 1079b5553490 |
| routing/gptq/Qwen3-0.6B/num_bits=4,group_size=128,num_samples=128,route_ratio=0.2,route=high/seed=0.json | Configuration | 9.9 MB | — |
| routing/gptq/Qwen3-0.6B/num_bits=4,group_size=128,num_samples=128,route_ratio=0.2,route=high/seed=1.json | Configuration | 9.7 MB | — |
| routing/gptq/Qwen3-0.6B/num_bits=4,group_size=128,num_samples=128,route_ratio=0.2,route=high/seed=2.json | Configuration | 9.8 MB | — |
| routing/gptq/Qwen3-0.6B/num_bits=4,group_size=128,num_samples=128,route_ratio=0.2,route=low/seed=0.json | Configuration | 12.0 MB | d7857967ff69 |
| routing/gptq/Qwen3-0.6B/num_bits=4,group_size=128,num_samples=128,route_ratio=0.2,route=random/seed=0.json | Configuration | 9.6 MB | — |
| routing/gptq/Qwen3-0.6B/num_bits=4,group_size=128,num_samples=128,route_ratio=0.2,route=random/seed=1.json | Configuration | 10.2 MB | — |
| routing/gptq/Qwen3-0.6B/num_bits=4,group_size=128,num_samples=128,route_ratio=0.2,route=random/seed=2.json | Configuration | 10.0 MB | — |
| routing/gptq/Qwen3-0.6B/num_bits=4,group_size=128,num_samples=128,route_ratio=0.8,route=low/seed=0.json | Configuration | 10.1 MB | — |
| routing/gptq/Qwen3-0.6B/num_bits=4,group_size=128,num_samples=128,route_ratio=0.8,route=random/seed=0.json | Configuration | 8.6 MB | — |
| routing/gptq/Qwen3-1.7B/num_bits=4,group_size=128,num_samples=128,route_ratio=0.1,route=high/seed=0.json | Configuration | 9.5 MB | — |
| routing/gptq/Qwen3-1.7B/num_bits=4,group_size=128,num_samples=128,route_ratio=0.1,route=high/seed=1.json | Configuration | 9.6 MB | — |
| routing/gptq/Qwen3-1.7B/num_bits=4,group_size=128,num_samples=128,route_ratio=0.1,route=high/seed=2.json | Configuration | 9.4 MB | — |
| routing/gptq/Qwen3-1.7B/num_bits=4,group_size=128,num_samples=128,route_ratio=0.1,route=random/seed=0.json | Configuration | 10.1 MB | — |
| routing/gptq/Qwen3-1.7B/num_bits=4,group_size=128,num_samples=128,route_ratio=0.1,route=random/seed=1.json | Configuration | 10.4 MB | — |
| routing/gptq/Qwen3-1.7B/num_bits=4,group_size=128,num_samples=128,route_ratio=0.1,route=random/seed=2.json | Configuration | 10.5 MB | 977ab3fee828 |
| routing/gptq/Qwen3-1.7B/num_bits=4,group_size=128,num_samples=128,route_ratio=0.2,route=high/seed=0.json | Configuration | 9.4 MB | — |
| routing/gptq/Qwen3-1.7B/num_bits=4,group_size=128,num_samples=128,route_ratio=0.2,route=high/seed=1.json | Configuration | 9.3 MB | — |
| routing/gptq/Qwen3-1.7B/num_bits=4,group_size=128,num_samples=128,route_ratio=0.2,route=high/seed=2.json | Configuration | 9.4 MB | — |
| routing/gptq/Qwen3-1.7B/num_bits=4,group_size=128,num_samples=128,route_ratio=0.2,route=low/seed=0.json | Configuration | 10.5 MB | — |
| routing/gptq/Qwen3-1.7B/num_bits=4,group_size=128,num_samples=128,route_ratio=0.2,route=random/seed=0.json | Configuration | 9.5 MB | — |
| routing/gptq/Qwen3-1.7B/num_bits=4,group_size=128,num_samples=128,route_ratio=0.2,route=random/seed=1.json | Configuration | 9.8 MB | — |
| routing/gptq/Qwen3-1.7B/num_bits=4,group_size=128,num_samples=128,route_ratio=0.2,route=random/seed=2.json | Configuration | 9.8 MB | — |
| routing/gptq/Qwen3-1.7B/num_bits=4,group_size=128,num_samples=128,route_ratio=0.8,route=low/seed=0.json | Configuration | 9.9 MB | — |
| routing/mxfp4/Qwen3-1.7B/group_size=32,route_ratio=0.2,route=high/seed=0.json | Configuration | 9.6 MB | — |
| routing/mxfp4/Qwen3-1.7B/group_size=32,route_ratio=0.2,route=high/seed=1.json | Configuration | 9.7 MB | — |
| routing/mxfp4/Qwen3-1.7B/group_size=32,route_ratio=0.2,route=high/seed=2.json | Configuration | 9.7 MB | — |
| .gitattributes | Repository | 9.5 KB | — |
License and Download
- License
- Not stated by the source
- Access
- Open weights, no gate
- Download size
- 34.7 GB
Download from Sehyun Park
Released by Sehyun Park through its official repository on Hugging Face.
Memory Requirements
| Precision | Weights in memory |
|---|---|
| As published | 34.7 GB |
Weights only, from the published parameter count; the key-value cache and runtime add to this.