Skip to page content
SAVRN
Search Plan a project

Open-weight model

entropy-aware-qat

by Sehyun Park sehyun734/entropy-aware-qat

entropy-aware-qat is an open-weight model from Sehyun Park. Its published files total 18.6 GB.

Parameters—
Context—
Weights18.1 GB
License—
AccessOpen weights
Monthly Downloads—

Model Card

The publisher has not written a card for this model.

Identity and Version

Repository
sehyun734/entropy-aware-qat
Publisher
Sehyun Park
Task
Not stated by the source
Modality
Other
Library
Not stated by the source
Parameters
Not stated by the source
Languages
Not stated by the source
Revision
ef3f3180b31f4a7168f4a43bfde86da16d3b33ab
First published
2026-10-09
Last updated
2026-10-13

Files and Weights

84 files, 18.6 GB in total. The weights are 20 files totalling 18.1 GB in safetensors.

Weights20 files · 18.1 GB
Configuration63 files · 524.9 MB
Repository1 file · 7.8 KB
Every file
FileTypeSizeSHA-256
calibration/Qwen3-0.6B/num_samples=128/outputs.safetensorsWeights2.0 MB 3a3af5a8f131
calibration/Qwen3-0.6B/num_samples=2048/outputs.safetensorsWeights92.4 MB b3bc29d2eaa8
calibration/Qwen3-1.7B/num_samples=128/outputs.safetensorsWeights2.1 MB 2d3e62afffe4
gptq/Qwen3-0.6B/num_bits=4,group_size=128,num_samples=128/grid.safetensorsWeights27.6 MB 6c80ba72af8f
gptq/Qwen3-0.6B/num_bits=4,group_size=128,num_samples=128/model.safetensorsWeights1.2 GB 36648eea8270
gptq/Qwen3-1.7B/num_bits=4,group_size=128,num_samples=128/grid.safetensorsWeights88.1 MB 13410c260bc3
gptq/Qwen3-1.7B/num_bits=4,group_size=128,num_samples=128/model.safetensorsWeights3.4 GB 1ba1a406d3e1
merge/Qwen3-0.6B/num_bits=4,group_size=128,num_samples=128/model.safetensorsWeights2.4 GB 83aa9acdea78
merge/Qwen3-1.7B/num_bits=4,group_size=128,num_samples=128/model.safetensorsWeights6.9 GB b28f41a14c56
qat/Qwen3-0.6B/num_bits=4,group_size=128,num_samples=128,qat_num_samples=2048,rollout_ratio=0,high_entropy_ratio=0.2,high_entropy_weight=1,learning_rate=0.0001,num_epochs=1/grid.safetensorsWeights27.6 MB 6c80ba72af8f
qat/Qwen3-0.6B/num_bits=4,group_size=128,num_samples=128,qat_num_samples=2048,rollout_ratio=0,high_entropy_ratio=0.2,high_entropy_weight=1,learning_rate=0.0001,num_epochs=1/model.safetensorsWeights1.2 GB 77ae481ab54f
qat/Qwen3-0.6B/num_bits=4,group_size=128,num_samples=128,qat_num_samples=2048,rollout_ratio=0,high_entropy_ratio=0.2,high_entropy_weight=3,learning_rate=0.0001,num_epochs=1/grid.safetensorsWeights27.6 MB 6c80ba72af8f
qat/Qwen3-0.6B/num_bits=4,group_size=128,num_samples=128,qat_num_samples=2048,rollout_ratio=0,high_entropy_ratio=0.2,high_entropy_weight=3,learning_rate=0.0001,num_epochs=1/model.safetensorsWeights1.2 GB b5fdccc9791d
qat/Qwen3-0.6B/num_bits=4,group_size=128,num_samples=128,qat_num_samples=2048,rollout_ratio=0.5,high_entropy_ratio=0.2,high_entropy_weight=1,learning_rate=0.0001,num_epochs=1/grid.safetensorsWeights27.6 MB 6c80ba72af8f
qat/Qwen3-0.6B/num_bits=4,group_size=128,num_samples=128,qat_num_samples=2048,rollout_ratio=0.5,high_entropy_ratio=0.2,high_entropy_weight=1,learning_rate=0.0001,num_epochs=1/model.safetensorsWeights1.2 GB 02ba0c2bb243
rollout/Qwen3-0.6B/num_bits=4,group_size=128,num_samples=128,rollout_num_samples=2048/outputs.safetensorsWeights95.7 MB 13bcb062c101
teacher_forcing/gptq/Qwen3-0.6B/num_bits=4,group_size=128,num_samples=128/seed=0.safetensorsWeights50.8 MB afeb0204b2a6
teacher_forcing/gptq/Qwen3-1.7B/num_bits=4,group_size=128,num_samples=128/seed=0.safetensorsWeights76.1 MB 6b5a6b2fff6b
teacher_forcing/qat/Qwen3-0.6B/num_bits=4,group_size=128,num_samples=128,qat_num_samples=2048,rollout_ratio=0,high_entropy_ratio=0.2,high_entropy_weight=1,learning_rate=0.0001,num_epochs=1/seed=0.safetensorsWeights50.8 MB 126f1601f51c
teacher_forcing/qat/Qwen3-0.6B/num_bits=4,group_size=128,num_samples=128,qat_num_samples=2048,rollout_ratio=0,high_entropy_ratio=0.2,high_entropy_weight=3,learning_rate=0.0001,num_epochs=1/seed=0.safetensorsWeights50.8 MB 9bbbbd95073d
calibration/Qwen3-0.6B/num_samples=128/rows.jsonConfiguration847.8 KB —
calibration/Qwen3-0.6B/num_samples=2048/rows.jsonConfiguration37.1 MB be3abcc7e28d
calibration/Qwen3-1.7B/num_samples=128/rows.jsonConfiguration853.8 KB —
gptq/Qwen3-0.6B/num_bits=4,group_size=128,num_samples=128/config.jsonConfiguration1.4 KB —
gptq/Qwen3-0.6B/num_bits=4,group_size=128,num_samples=128/generation_config.jsonConfiguration214 B —
gptq/Qwen3-1.7B/num_bits=4,group_size=128,num_samples=128/config.jsonConfiguration1.4 KB —
gptq/Qwen3-1.7B/num_bits=4,group_size=128,num_samples=128/generation_config.jsonConfiguration214 B —
math500/bf16/Qwen3-0.6B/seed=0.jsonConfiguration8.9 MB —
math500/bf16/Qwen3-0.6B/seed=1.jsonConfiguration8.8 MB —
math500/bf16/Qwen3-0.6B/seed=2.jsonConfiguration8.9 MB —
math500/bf16/Qwen3-1.7B/seed=0.jsonConfiguration8.5 MB —
math500/bf16/Qwen3-1.7B/seed=1.jsonConfiguration8.3 MB —
math500/bf16/Qwen3-1.7B/seed=2.jsonConfiguration8.7 MB —
math500/gptq/Qwen3-0.6B/num_bits=4,group_size=128,num_samples=128/seed=0.jsonConfiguration11.3 MB 3a735c4a2df5
math500/gptq/Qwen3-0.6B/num_bits=4,group_size=128,num_samples=128/seed=1.jsonConfiguration11.3 MB 716c27be5f03
math500/gptq/Qwen3-0.6B/num_bits=4,group_size=128,num_samples=128/seed=2.jsonConfiguration10.7 MB 305c7602f585
math500/gptq/Qwen3-1.7B/num_bits=4,group_size=128,num_samples=128/seed=0.jsonConfiguration10.4 MB —
math500/gptq/Qwen3-1.7B/num_bits=4,group_size=128,num_samples=128/seed=1.jsonConfiguration10.6 MB f3157b9cf938
math500/gptq/Qwen3-1.7B/num_bits=4,group_size=128,num_samples=128/seed=2.jsonConfiguration10.6 MB cf72b11751c7
math500/qat/Qwen3-0.6B/num_bits=4,group_size=128,num_samples=128,qat_num_samples=2048,rollout_ratio=0,high_entropy_ratio=0.2,high_entropy_weight=1,learning_rate=0.0001,num_epochs=1/seed=0.jsonConfiguration9.7 MB —
math500/qat/Qwen3-0.6B/num_bits=4,group_size=128,num_samples=128,qat_num_samples=2048,rollout_ratio=0,high_entropy_ratio=0.2,high_entropy_weight=1,learning_rate=0.0001,num_epochs=1/seed=1.jsonConfiguration10.6 MB 1cdc046d6028
math500/qat/Qwen3-0.6B/num_bits=4,group_size=128,num_samples=128,qat_num_samples=2048,rollout_ratio=0,high_entropy_ratio=0.2,high_entropy_weight=1,learning_rate=0.0001,num_epochs=1/seed=2.jsonConfiguration10.7 MB 47042b121bed
math500/qat/Qwen3-0.6B/num_bits=4,group_size=128,num_samples=128,qat_num_samples=2048,rollout_ratio=0,high_entropy_ratio=0.2,high_entropy_weight=3,learning_rate=0.0001,num_epochs=1/seed=0.jsonConfiguration10.4 MB —
math500/qat/Qwen3-0.6B/num_bits=4,group_size=128,num_samples=128,qat_num_samples=2048,rollout_ratio=0,high_entropy_ratio=0.2,high_entropy_weight=3,learning_rate=0.0001,num_epochs=1/seed=1.jsonConfiguration10.6 MB 753d76d7582b
math500/qat/Qwen3-0.6B/num_bits=4,group_size=128,num_samples=128,qat_num_samples=2048,rollout_ratio=0,high_entropy_ratio=0.2,high_entropy_weight=3,learning_rate=0.0001,num_epochs=1/seed=2.jsonConfiguration10.5 MB 5047532f0b75
math500/qat/Qwen3-0.6B/num_bits=4,group_size=128,num_samples=128,qat_num_samples=2048,rollout_ratio=0.5,high_entropy_ratio=0.2,high_entropy_weight=1,learning_rate=0.0001,num_epochs=1/seed=0.jsonConfiguration9.8 MB —
math500/qat/Qwen3-0.6B/num_bits=4,group_size=128,num_samples=128,qat_num_samples=2048,rollout_ratio=0.5,high_entropy_ratio=0.2,high_entropy_weight=1,learning_rate=0.0001,num_epochs=1/seed=1.jsonConfiguration9.7 MB —
math500/qat/Qwen3-0.6B/num_bits=4,group_size=128,num_samples=128,qat_num_samples=2048,rollout_ratio=0.5,high_entropy_ratio=0.2,high_entropy_weight=1,learning_rate=0.0001,num_epochs=1/seed=2.jsonConfiguration9.8 MB —
merge/Qwen3-0.6B/num_bits=4,group_size=128,num_samples=128/config.jsonConfiguration2.0 KB —
merge/Qwen3-0.6B/num_bits=4,group_size=128,num_samples=128/generation_config.jsonConfiguration239 B —
merge/Qwen3-1.7B/num_bits=4,group_size=128,num_samples=128/config.jsonConfiguration2.0 KB —
merge/Qwen3-1.7B/num_bits=4,group_size=128,num_samples=128/generation_config.jsonConfiguration239 B —
qat/Qwen3-0.6B/num_bits=4,group_size=128,num_samples=128,qat_num_samples=2048,rollout_ratio=0,high_entropy_ratio=0.2,high_entropy_weight=1,learning_rate=0.0001,num_epochs=1/config.jsonConfiguration1.4 KB —
qat/Qwen3-0.6B/num_bits=4,group_size=128,num_samples=128,qat_num_samples=2048,rollout_ratio=0,high_entropy_ratio=0.2,high_entropy_weight=1,learning_rate=0.0001,num_epochs=1/generation_config.jsonConfiguration214 B —
qat/Qwen3-0.6B/num_bits=4,group_size=128,num_samples=128,qat_num_samples=2048,rollout_ratio=0,high_entropy_ratio=0.2,high_entropy_weight=3,learning_rate=0.0001,num_epochs=1/config.jsonConfiguration1.4 KB —
qat/Qwen3-0.6B/num_bits=4,group_size=128,num_samples=128,qat_num_samples=2048,rollout_ratio=0,high_entropy_ratio=0.2,high_entropy_weight=3,learning_rate=0.0001,num_epochs=1/generation_config.jsonConfiguration214 B —
qat/Qwen3-0.6B/num_bits=4,group_size=128,num_samples=128,qat_num_samples=2048,rollout_ratio=0.5,high_entropy_ratio=0.2,high_entropy_weight=1,learning_rate=0.0001,num_epochs=1/config.jsonConfiguration1.4 KB —
qat/Qwen3-0.6B/num_bits=4,group_size=128,num_samples=128,qat_num_samples=2048,rollout_ratio=0.5,high_entropy_ratio=0.2,high_entropy_weight=1,learning_rate=0.0001,num_epochs=1/generation_config.jsonConfiguration214 B —
rollout/Qwen3-0.6B/num_bits=4,group_size=128,num_samples=128,rollout_num_samples=2048/rows.jsonConfiguration38.2 MB 91ce30ee8586
routing/Qwen3-0.6B/num_bits=4,group_size=128,num_samples=128,route_ratio=0.1,route=high/seed=0.jsonConfiguration10.5 MB —
routing/Qwen3-0.6B/num_bits=4,group_size=128,num_samples=128,route_ratio=0.1,route=high/seed=1.jsonConfiguration9.7 MB —
routing/Qwen3-0.6B/num_bits=4,group_size=128,num_samples=128,route_ratio=0.1,route=high/seed=2.jsonConfiguration9.8 MB —
routing/Qwen3-0.6B/num_bits=4,group_size=128,num_samples=128,route_ratio=0.1,route=random/seed=0.jsonConfiguration10.2 MB —
routing/Qwen3-0.6B/num_bits=4,group_size=128,num_samples=128,route_ratio=0.1,route=random/seed=1.jsonConfiguration10.7 MB 29dfac8d5489
routing/Qwen3-0.6B/num_bits=4,group_size=128,num_samples=128,route_ratio=0.1,route=random/seed=2.jsonConfiguration11.0 MB 1079b5553490
routing/Qwen3-0.6B/num_bits=4,group_size=128,num_samples=128,route_ratio=0.2,route=high/seed=0.jsonConfiguration9.9 MB —
routing/Qwen3-0.6B/num_bits=4,group_size=128,num_samples=128,route_ratio=0.2,route=high/seed=1.jsonConfiguration9.7 MB —
routing/Qwen3-0.6B/num_bits=4,group_size=128,num_samples=128,route_ratio=0.2,route=high/seed=2.jsonConfiguration9.8 MB —
routing/Qwen3-0.6B/num_bits=4,group_size=128,num_samples=128,route_ratio=0.2,route=low/seed=0.jsonConfiguration12.0 MB d7857967ff69
routing/Qwen3-0.6B/num_bits=4,group_size=128,num_samples=128,route_ratio=0.2,route=random/seed=0.jsonConfiguration9.6 MB —
routing/Qwen3-0.6B/num_bits=4,group_size=128,num_samples=128,route_ratio=0.2,route=random/seed=1.jsonConfiguration10.2 MB —
routing/Qwen3-0.6B/num_bits=4,group_size=128,num_samples=128,route_ratio=0.2,route=random/seed=2.jsonConfiguration10.0 MB —
routing/Qwen3-0.6B/num_bits=4,group_size=128,num_samples=128,route_ratio=0.8,route=low/seed=0.jsonConfiguration10.1 MB —
routing/Qwen3-0.6B/num_bits=4,group_size=128,num_samples=128,route_ratio=0.8,route=random/seed=0.jsonConfiguration8.6 MB —
routing/Qwen3-1.7B/num_bits=4,group_size=128,num_samples=128,route_ratio=0.1,route=high/seed=0.jsonConfiguration9.5 MB —
routing/Qwen3-1.7B/num_bits=4,group_size=128,num_samples=128,route_ratio=0.1,route=random/seed=0.jsonConfiguration10.1 MB —
routing/Qwen3-1.7B/num_bits=4,group_size=128,num_samples=128,route_ratio=0.2,route=high/seed=0.jsonConfiguration9.4 MB —
routing/Qwen3-1.7B/num_bits=4,group_size=128,num_samples=128,route_ratio=0.2,route=high/seed=1.jsonConfiguration9.3 MB —
routing/Qwen3-1.7B/num_bits=4,group_size=128,num_samples=128,route_ratio=0.2,route=high/seed=2.jsonConfiguration9.4 MB —
routing/Qwen3-1.7B/num_bits=4,group_size=128,num_samples=128,route_ratio=0.2,route=low/seed=0.jsonConfiguration10.5 MB —
routing/Qwen3-1.7B/num_bits=4,group_size=128,num_samples=128,route_ratio=0.2,route=random/seed=0.jsonConfiguration9.5 MB —
routing/Qwen3-1.7B/num_bits=4,group_size=128,num_samples=128,route_ratio=0.2,route=random/seed=1.jsonConfiguration9.8 MB —
routing/Qwen3-1.7B/num_bits=4,group_size=128,num_samples=128,route_ratio=0.2,route=random/seed=2.jsonConfiguration9.8 MB —
.gitattributesRepository7.8 KB —

License and Download

License
Not stated by the source
Access
Open weights, no gate
Download size
18.1 GB
Download from Sehyun Park

Released by Sehyun Park through its official repository on Hugging Face.

Memory Requirements

PrecisionWeights in memory
As published18.1 GB

Weights only, from the published parameter count; the key-value cache and runtime add to this.