SAVRN
Search Contact SAVRN

Dataset · Text classification

jev-bench

by Praveen Raj U S Praveenrajus/jev-bench

Real human-labeled data, reformatted into System One questions — with human label distributions wherever they exist. 22 configs · 166,054 rows · 22,773 on the same 22,773 test records.

Rows99,989
Configurations12
Size2.9 GB
Licenseother
AccessPublicly accessible
Monthly Downloads7.4k

Dataset Card

Real human-labeled data, reformatted into System One questions — with human label distributions wherever they exist. 22 configs · 166,054 rows · 22,773 on the same 22,773 test records. Down and to the right is better; the stars are open models fine-tuned on their own decision readout with a coherence penalty. Contents — model (TypeSafe's Jev, or any open model Jevified by the engine) does not write text. It reads a state, answers typed questions, and returns probability distributions your code can branch on. The product claim is calibration: an answer given 0.8 should be right about 80% of the time. Most benchmarks can only check the argmax; jev-bench checks the distribution — four configs…

Excerpt from the card by Praveen Raj U S, licensed other.

Structure

arc_challenge 2,418 rows

SplitRowsSize
test1,000635.2 KB
validation299195.2 KB
train1,119707.9 KB
idstringsourcestringprimitivestringsplitstringstatestringquestionstringlabelstringsoft_labelnullmetastring

banking77 9,500 rows

SplitRowsSize
test1,0004.2 MB
validation5002.1 MB
train8,00033.3 MB
idstringsourcestringprimitivestringsplitstringstatestringquestionstringlabelstringsoft_labelnullmetastring

boolq 9,472 rows

SplitRowsSize
test1,000953.6 KB
validation472455.7 KB
train8,0007.5 MB
idstringsourcestringprimitivestringsplitstringstatestringquestionstringlabelstringsoft_labelnullmetastring

chaosnli 1,599 rows

SplitRowsSize
test1,5991.6 MB
idstringsourcestringprimitivestringsplitstringstatestringquestionstringlabelstringsoft_labelstringmetastring

civil_comments 10,500 rows

SplitRowsSize
test2,0001.5 MB
validation500372.2 KB
train8,0006.0 MB
idstringsourcestringprimitivestringsplitstringstatestringquestionstringlabelstringsoft_labelstringmetastring

clinc150 9,500 rows

SplitRowsSize
test1,0005.2 MB
validation5002.6 MB
train8,00041.7 MB
idstringsourcestringprimitivestringsplitstringstatestringquestionstringlabelstringsoft_labelnullmetastring

fever_evidence 9,500 rows

SplitRowsSize
test1,000672.5 KB
validation500337.5 KB
train8,0005.5 MB
idstringsourcestringprimitivestringsplitstringstatestringquestionstringlabelstringsoft_labelnullmetastring

go_emotions 9,500 rows

SplitRowsSize
test1,0001.5 MB
validation500737.6 KB
train8,00011.7 MB
idstringsourcestringprimitivestringsplitstringstatestringquestionstringlabelstringsoft_labelstringmetastring

helpsteer2_helpfulness 9,500 rows

SplitRowsSize
test1,0003.1 MB
validation5001.6 MB
train8,00025.1 MB
idstringsourcestringprimitivestringsplitstringstatestringquestionstringlabelstringsoft_labelnullmetastring

helpsteer2_verbosity 9,500 rows

SplitRowsSize
test1,0003.2 MB
validation5001.6 MB
train8,00025.9 MB
idstringsourcestringprimitivestringsplitstringstatestringquestionstringlabelstringsoft_labelnullmetastring

ledgar 9,500 rows

SplitRowsSize
test1,0003.1 MB
validation5001.6 MB
train8,00025.5 MB
idstringsourcestringprimitivestringsplitstringstatestringquestionstringlabelstringsoft_labelnullmetastring

massive 9,500 rows

SplitRowsSize
test1,0002.5 MB
validation5001.3 MB
train8,00020.3 MB
idstringsourcestringprimitivestringsplitstringstatestringquestionstringlabelstringsoft_labelnullmetastring

Details

Repository
Praveenrajus/jev-bench
Publisher
Praveen Raj U S
Task category
Text classification
Tags
calibration, system-one, decision-model
Size category
100K<n<1M
Languages
en
Revision
0ade9f95b41e89b0d4e7dd5c52cb15f657f085b8
Last updated
2026-10-02

Files

1,563 files, 2.9 GB in total.

Data706 files · 2.4 GB
Documentation168 files · 489.3 KB
Other688 files · 516.3 MB
Repository1 file · 7.5 KB
Every file
FileTypeSizeSHA-256
data/arc_challenge/test.jsonlData786.2 KB—
data/arc_challenge/train.jsonlData876.9 KB—
data/arc_challenge/validation.jsonlData240.4 KB—
data/banking77/test.jsonlData4.6 MB—
data/banking77/train.jsonlData36.8 MB515819bb43ad
data/banking77/validation.jsonlData2.3 MB—
data/boolq/test.jsonlData1.1 MB—
data/boolq/train.jsonlData8.6 MB—
data/boolq/validation.jsonlData518.5 KB—
data/chaosnli/test.jsonlData1.8 MB—
data/civil_comments/test.jsonlData1.7 MB—
data/civil_comments/train.jsonlData7.0 MB—
data/civil_comments/validation.jsonlData439.8 KB—
data/clinc150/test.jsonlData5.9 MB—
data/clinc150/train.jsonlData47.6 MB5222891eab0e
data/clinc150/validation.jsonlData3.0 MB—
data/fever_evidence/test.jsonlData813.9 KB—
data/fever_evidence/train.jsonlData6.6 MB—
data/fever_evidence/validation.jsonlData408.3 KB—
data/go_emotions/test.jsonlData1.7 MB—
data/go_emotions/train.jsonlData13.7 MBf04de8b497af
data/go_emotions/validation.jsonlData859.6 KB—
data/helpsteer2_helpfulness/test.jsonlData3.3 MB—
data/helpsteer2_helpfulness/train.jsonlData26.5 MB47e6fa056782
data/helpsteer2_helpfulness/validation.jsonlData1.6 MB—
data/helpsteer2_verbosity/test.jsonlData3.4 MB—
data/helpsteer2_verbosity/train.jsonlData27.3 MBf673a1f239e7
data/helpsteer2_verbosity/validation.jsonlData1.7 MB—
data/ledgar/test.jsonlData3.5 MB—
data/ledgar/train.jsonlData28.1 MB31f6a101fd55
data/ledgar/validation.jsonlData1.8 MB—
data/massive/test.jsonlData2.9 MB—
data/massive/train.jsonlData23.3 MB6c1b0120bf55
data/massive/validation.jsonlData1.5 MB—
data/measuring_hate_speech/test.jsonlData913.3 KB—
data/measuring_hate_speech/train.jsonlData7.4 MB—
data/measuring_hate_speech/validation.jsonlData464.8 KB—
data/mmlu/test.jsonlData996.1 KB—
data/mmlu/train.jsonlData264.4 KB—
data/mmlu/validation.jsonlData491.1 KB—
data/mnli/test.jsonlData901.3 KB—
data/mnli/train.jsonlData7.3 MB—
data/mnli/validation.jsonlData459.8 KB—
data/paws/test.jsonlData749.9 KB—
data/paws/train.jsonlData6.0 MB—
data/paws/validation.jsonlData383.0 KB—
data/sms_spam/test.jsonlData400.9 KB—
data/sms_spam/train.jsonlData2.0 MB—
data/sms_spam/validation.jsonlData119.7 KB—
data/sst5/test.jsonlData795.3 KB—
data/sst5/train.jsonlData6.4 MB—
data/sst5/validation.jsonlData402.8 KB—
data/strategyqa_closed/test.jsonlData357.5 KB—
data/strategyqa_closed/train.jsonlData731.6 KB—
data/strategyqa_closed/validation.jsonlData85.0 KB—
data/strategyqa_grounded/test.jsonlData502.8 KB—
data/strategyqa_grounded/train.jsonlData1.0 MB—
data/strategyqa_grounded/validation.jsonlData118.0 KB—
data/stsb/test.jsonlData982.3 KB—
data/stsb/train.jsonlData5.7 MB—
data/stsb/validation.jsonlData507.9 KB—
data/yelp5/test.jsonlData1.5 MB—
data/yelp5/train.jsonlData11.4 MB81935db335f4
data/yelp5/validation.jsonlData727.5 KB—
manifest.jsonData14.6 KB—
results/b/predictions/jev/test_predictions.jsonlData1.0 MB—
results/b/predictions/qwen35-4b-t2-lowlr/test_predictions.jsonlData1.1 MB—
results/b/predictions/qwen35-4b/test_predictions.jsonlData2.0 MB—
results/b/predictions/qwen35-9b/test_predictions.jsonlData1.9 MB—
results/b/predictions/tev1-4b/test_predictions.jsonlData2.3 MB—
results/b/report.jsonData17.3 KB—
results/c/b/report.jsonData19.2 KB—
results/c/community/report.jsonData28.1 KB—
results/c/jev-bench/comparison.jsonData24.7 KB—
results/c/predictions/b/qwen35-4b-t2-lowlr-rerun/test_predictions.jsonlData1.1 MB—
results/c/predictions/b/qwen35-4b-t2-lowlr-shuf/test_predictions.jsonlData1.0 MB—
results/c/predictions/b/qwen35-4b-t2-lowlr-tev1syn-shuf/test_predictions.jsonlData1.1 MB—
results/c/predictions/b/qwen35-4b-t2-lowlr-tev1syn/test_predictions.jsonlData1.1 MB—
results/c/predictions/community/qwen35-4b-t2-lowlr-rerun/test_predictions.jsonlData2.5 MB—
results/c/predictions/community/qwen35-4b-t2-lowlr-rerun/unlabelled_predictions.jsonlData2.5 KB—
results/c/predictions/community/qwen35-4b-t2-lowlr-shuf/test_predictions.jsonlData2.5 MB—
results/c/predictions/community/qwen35-4b-t2-lowlr-shuf/unlabelled_predictions.jsonlData2.5 KB—
results/c/predictions/community/qwen35-4b-t2-lowlr-tev1syn-shuf/test_predictions.jsonlData2.6 MB—
results/c/predictions/community/qwen35-4b-t2-lowlr-tev1syn-shuf/unlabelled_predictions.jsonlData2.5 KB—
results/c/predictions/community/qwen35-4b-t2-lowlr-tev1syn/test_predictions.jsonlData2.6 MB—
results/c/predictions/community/qwen35-4b-t2-lowlr-tev1syn/unlabelled_predictions.jsonlData2.5 KB—
results/c/runs/qwen35-4b-t2-lowlr-rerun/run.jsonData883 B—
results/c/runs/qwen35-4b-t2-lowlr-rerun/test_metrics.jsonData43.4 KB—
results/c/runs/qwen35-4b-t2-lowlr-rerun/test_predictions.jsonlData23.8 MB22ad19fba359
results/c/runs/qwen35-4b-t2-lowlr-shuf/run.jsonData908 B—
results/c/runs/qwen35-4b-t2-lowlr-shuf/test_metrics.jsonData43.4 KB—
results/c/runs/qwen35-4b-t2-lowlr-shuf/test_predictions.jsonlData23.8 MB8bcbdf926ba1
results/c/runs/qwen35-4b-t2-lowlr-tev1syn-shuf/run.jsonData995 B—
results/c/runs/qwen35-4b-t2-lowlr-tev1syn-shuf/test_metrics.jsonData44.0 KB—
results/c/runs/qwen35-4b-t2-lowlr-tev1syn-shuf/test_predictions.jsonlData23.8 MB49b743ea76f3
results/c/runs/qwen35-4b-t2-lowlr-tev1syn/run.jsonData965 B—
results/c/runs/qwen35-4b-t2-lowlr-tev1syn/test_metrics.jsonData43.9 KB—
results/c/runs/qwen35-4b-t2-lowlr-tev1syn/test_predictions.jsonlData23.8 MB7d6023a57ad0
results/clm-8b/test_metrics.jsonData41.7 KB—
results/clm-8b/test_predictions.jsonlData24.9 MB14684c57a6e1
results/community/predictions/clm-8b/test_predictions.jsonlData3.0 MB—
results/community/predictions/clm-8b/unlabelled_predictions.jsonlData2.8 KB—
results/community/predictions/gemma4-12b/test_predictions.jsonlData4.8 MB—
results/community/predictions/gemma4-12b/unlabelled_predictions.jsonlData5.6 KB—
results/community/predictions/jev-1.13.0/test_predictions.jsonlData2.5 MB—
results/community/predictions/jev-1.13.0/unlabelled_predictions.jsonlData2.1 KB—
results/community/predictions/qwen35-4b-t2-lowlr/test_predictions.jsonlData2.6 MB—
results/community/predictions/qwen35-4b-t2-lowlr/unlabelled_predictions.jsonlData2.5 KB—
results/community/predictions/qwen35-4b-tev1fmt/test_predictions.jsonlData5.0 MB—
results/community/predictions/qwen35-4b-tev1fmt/unlabelled_predictions.jsonlData5.7 KB—
results/community/predictions/qwen35-4b/test_predictions.jsonlData4.7 MB—
results/community/predictions/qwen35-4b/unlabelled_predictions.jsonlData5.5 KB—
results/community/predictions/qwen35-9b/test_predictions.jsonlData4.7 MB—
results/community/predictions/qwen35-9b/unlabelled_predictions.jsonlData5.5 KB—
results/community/predictions/tev1-4b/test_predictions.jsonlData5.2 MB—
results/community/predictions/tev1-4b/unlabelled_predictions.jsonlData5.8 KB—
results/community/report.jsonData37.3 KB—
results/gemma4-12b-vision/recipe.jsonData1.2 KB—
results/gemma4-12b-vision/run.jsonData632 B—
results/gemma4-12b-vision/test_metrics.jsonData5.9 KB—
results/gemma4-12b-vision/test_predictions.jsonlData1.8 MB—
results/gemma4-12b-vision/test_records.jsonlData2.6 MB—
results/gemma4-12b/recipe.jsonData2.4 KB—
results/gemma4-12b/run.jsonData668 B—
results/gemma4-12b/run_validation.jsonData681 B—
results/gemma4-12b/test_metrics.jsonData41.3 KB—
results/gemma4-12b/test_predictions.jsonlData67.4 MB22d287a1418e
results/gemma4-e2b-it/recipe.jsonData2.5 KB—
results/gemma4-e2b-it/run.jsonData624 B—
results/gemma4-e2b-it/run_validation.jsonData636 B—
results/gemma4-e2b-it/test_metrics.jsonData43.7 KB—
results/gemma4-e2b-it/test_predictions.jsonlData69.4 MB6ea853bf7ace
results/gemma4-e2b/recipe.jsonData2.5 KB—
results/gemma4-e2b/run.jsonData619 B—
results/gemma4-e2b/run_validation.jsonData633 B—
results/gemma4-e2b/test_metrics.jsonData30.6 KB—
results/gemma4-e2b/test_predictions.jsonlData69.5 MBe40a94004a14
results/gemma4-e4b-it/recipe.jsonData2.5 KB—
results/gemma4-e4b-it/run.jsonData672 B—
results/gemma4-e4b-it/run_validation.jsonData688 B—
results/gemma4-e4b-it/test_metrics.jsonData43.0 KB—
results/gemma4-e4b-it/test_predictions.jsonlData70.4 MBfbac799bb0cd
results/jev-1.13.0/probes/probes.jsonData14.7 KB—
results/jev-1.13.0/probes/test_predictions.jsonlData14.9 MB93cb37a6cef4
results/jev-1.13.0/test_metrics.jsonData44.3 KB—
results/jev-1.13.0/test_predictions.jsonlData15.9 MBb2f27ae059db
results/jev-latency-probe/probe.jsonData94.2 KB—
results/jev-latency-probe/probe_round2.jsonData50.8 KB—
results/k2-horizon-0.9b/recipe.jsonData2.5 KB—
results/k2-horizon-0.9b/run.jsonData624 B—
results/k2-horizon-0.9b/run_validation.jsonData625 B—
results/k2-horizon-0.9b/test_metrics.jsonData38.6 KB—
results/k2-horizon-0.9b/test_predictions.jsonlData69.7 MB3a90b4cd831b
results/k2-horizon-7b/recipe.jsonData2.5 KB—
results/k2-horizon-7b/run.jsonData626 B—
results/k2-horizon-7b/run_validation.jsonData640 B—
results/k2-horizon-7b/test_metrics.jsonData44.3 KB—
results/k2-horizon-7b/test_predictions.jsonlData69.7 MB62d05f760f0f
results/latency/latency.jsonData14.7 KB—
results/latency/latency_8b.jsonData3.6 KB—
results/latency/latency_8b_vllm.jsonData2.4 KB—
results/latency/latency_generate_gemma4-12b-vision.jsonData858 B—
results/latency/latency_generate_gemma4-12b.jsonData1.2 KB—
results/latency/latency_generate_qwen35-9b-vision.jsonData851 B—
results/latency/latency_generate_qwen35-9b.jsonData1.2 KB—
results/latency/latency_generate_qwen3vl-8b.jsonData865 B—
results/latency/latency_vision.jsonData756 B—
results/latency/latency_vision_gemma4-12b-vision.jsonData749 B—
results/latency/latency_vision_multi.jsonData827 B—
results/latency/latency_vision_qwen35-9b-vision.jsonData747 B—
results/latency/latency_vision_qwen3vl-8b.jsonData760 B—
results/latency/latency_vllm.jsonData8.6 KB—
results/latency/latency_vllm_statelast.jsonData3.6 KB—
results/leaderboard/leaderboard.jsonData41.1 KB—
results/phishing-recalibration/models.jsonData842 B—
results/phishing-recalibration/report.jsonData64.5 KB—
results/post-training/models/2b-full-ft-coherence-lr-1e-6/coherence.jsonData27.6 KB—
results/post-training/models/2b-full-ft-coherence-lr-1e-6/entry.jsonData137 B—
results/post-training/models/2b-full-ft-coherence-lr-1e-6/probes.jsonData14.4 KB—
results/post-training/models/2b-full-ft-coherence-lr-1e-6/recipe.jsonData2.5 KB—
results/post-training/models/2b-full-ft-coherence-lr-1e-6/tags.jsonData2.6 KB—
results/post-training/models/2b-full-ft-coherence-lr-1e-6/test_metrics.jsonData43.5 KB—
results/post-training/models/2b-full-ft-coherence-lr-3e-6/coherence.jsonData27.6 KB—
results/post-training/models/2b-full-ft-coherence-lr-3e-6/entry.jsonData137 B—
results/post-training/models/2b-full-ft-coherence-lr-3e-6/probes.jsonData14.2 KB—
results/post-training/models/2b-full-ft-coherence-lr-3e-6/recipe.jsonData2.4 KB—
results/post-training/models/2b-full-ft-coherence-lr-3e-6/tags.jsonData2.6 KB—
results/post-training/models/2b-full-ft-coherence-lr-3e-6/test_metrics.jsonData43.3 KB—
results/post-training/models/2b-full-ft-supervised-lr-1e-5/coherence.jsonData27.4 KB—
results/post-training/models/2b-full-ft-supervised-lr-1e-5/entry.jsonData136 B—
results/post-training/models/2b-full-ft-supervised-lr-1e-5/probes.jsonData14.4 KB—
results/post-training/models/2b-full-ft-supervised-lr-1e-5/recipe.jsonData2.5 KB—
results/post-training/models/2b-full-ft-supervised-lr-1e-5/tags.jsonData2.6 KB—
results/post-training/models/2b-full-ft-supervised-lr-1e-5/test_metrics.jsonData41.1 KB—
results/post-training/models/2b-full-ft-supervised-lr-1e-6/coherence.jsonData27.5 KB—
results/post-training/models/2b-full-ft-supervised-lr-1e-6/entry.jsonData136 B—
results/post-training/models/2b-full-ft-supervised-lr-1e-6/probes.jsonData14.3 KB—
results/post-training/models/2b-full-ft-supervised-lr-1e-6/recipe.jsonData2.4 KB—
results/post-training/models/2b-full-ft-supervised-lr-1e-6/tags.jsonData2.6 KB—
results/post-training/models/2b-full-ft-supervised-lr-1e-6/test_metrics.jsonData44.0 KB—
results/post-training/models/2b-full-ft-supervised-lr-3e-6/coherence.jsonData27.4 KB—
results/post-training/models/2b-full-ft-supervised-lr-3e-6/entry.jsonData136 B—
results/post-training/models/2b-full-ft-supervised-lr-3e-6/probes.jsonData14.3 KB—
results/post-training/models/2b-full-ft-supervised-lr-3e-6/recipe.jsonData2.5 KB—
results/post-training/models/2b-full-ft-supervised-lr-3e-6/tags.jsonData2.6 KB—
results/post-training/models/2b-full-ft-supervised-lr-3e-6/test_metrics.jsonData43.2 KB—
results/post-training/models/2b-full-ft-supervised-lr-3e-7/coherence.jsonData27.6 KB—
results/post-training/models/2b-full-ft-supervised-lr-3e-7/entry.jsonData136 B—
results/post-training/models/2b-full-ft-supervised-lr-3e-7/probes.jsonData14.4 KB—
results/post-training/models/2b-full-ft-supervised-lr-3e-7/recipe.jsonData2.5 KB—
results/post-training/models/2b-full-ft-supervised-lr-3e-7/tags.jsonData2.5 KB—
results/post-training/models/2b-full-ft-supervised-lr-3e-7/test_metrics.jsonData44.4 KB—
results/post-training/models/2b-lora-coherence/coherence.jsonData27.6 KB—
results/post-training/models/2b-lora-coherence/entry.jsonData125 B—
results/post-training/models/2b-lora-coherence/probes.jsonData14.4 KB—
results/post-training/models/2b-lora-coherence/recipe.jsonData2.5 KB—
results/post-training/models/2b-lora-coherence/tags.jsonData2.6 KB—
results/post-training/models/2b-lora-coherence/test_metrics.jsonData44.2 KB—
results/post-training/models/2b-lora-supervised/coherence.jsonData27.1 KB—
results/post-training/models/2b-lora-supervised/entry.jsonData124 B—
results/post-training/models/2b-lora-supervised/probes.jsonData14.1 KB—
results/post-training/models/2b-lora-supervised/recipe.jsonData2.5 KB—
results/post-training/models/2b-lora-supervised/tags.jsonData2.6 KB—
results/post-training/models/2b-lora-supervised/test_metrics.jsonData43.7 KB—
results/post-training/models/4b-lora-coherence-seed-0/coherence.jsonData27.6 KB—
results/post-training/models/4b-lora-coherence-seed-0/entry.jsonData133 B—
results/post-training/models/4b-lora-coherence-seed-0/probes.jsonData14.3 KB—
results/post-training/models/4b-lora-coherence-seed-0/recipe.jsonData2.5 KB—
results/post-training/models/4b-lora-coherence-seed-0/tags.jsonData2.6 KB—
results/post-training/models/4b-lora-coherence-seed-0/test_metrics.jsonData44.2 KB—
results/post-training/models/4b-lora-coherence-seed-1/coherence.jsonData27.6 KB—
results/post-training/models/4b-lora-coherence-seed-1/entry.jsonData133 B—
results/post-training/models/4b-lora-coherence-seed-1/probes.jsonData14.3 KB—
results/post-training/models/4b-lora-coherence-seed-1/recipe.jsonData2.5 KB—
results/post-training/models/4b-lora-coherence-seed-1/tags.jsonData2.5 KB—
results/post-training/models/4b-lora-coherence-seed-1/test_metrics.jsonData43.1 KB—
results/post-training/models/4b-lora-supervised-seed-0/coherence.jsonData27.7 KB—
results/post-training/models/4b-lora-supervised-seed-0/entry.jsonData132 B—
results/post-training/models/4b-lora-supervised-seed-0/probes.jsonData14.4 KB—
results/post-training/models/4b-lora-supervised-seed-0/recipe.jsonData2.4 KB—
results/post-training/models/4b-lora-supervised-seed-0/tags.jsonData2.5 KB—
results/post-training/models/4b-lora-supervised-seed-0/test_metrics.jsonData43.9 KB—
results/post-training/models/4b-lora-supervised-seed-1/coherence.jsonData27.5 KB—
results/post-training/models/4b-lora-supervised-seed-1/entry.jsonData132 B—
results/post-training/models/4b-lora-supervised-seed-1/probes.jsonData14.4 KB—
results/post-training/models/4b-lora-supervised-seed-1/recipe.jsonData2.5 KB—
results/post-training/models/4b-lora-supervised-seed-1/tags.jsonData2.6 KB—
results/post-training/models/4b-lora-supervised-seed-1/test_metrics.jsonData43.5 KB—
results/post-training/models/9b-lora-coherence/coherence.jsonData27.7 KB—
results/post-training/models/9b-lora-coherence/entry.jsonData136 B—
results/post-training/models/9b-lora-coherence/recipe.jsonData2.5 KB—
results/post-training/models/9b-lora-coherence/test_metrics.jsonData44.6 KB—
results/post-training/models/9b-lora-supervised/coherence.jsonData27.5 KB—
results/post-training/models/9b-lora-supervised/entry.jsonData135 B—
results/post-training/models/9b-lora-supervised/probes.jsonData14.5 KB—
results/post-training/models/9b-lora-supervised/recipe.jsonData2.4 KB—
results/post-training/models/9b-lora-supervised/tags.jsonData2.6 KB—
results/post-training/models/9b-lora-supervised/test_metrics.jsonData43.7 KB—
results/post-training/models/gemma-4-e2b-it-no-template/coherence.jsonData27.4 KB—
results/post-training/models/gemma-4-e2b-it-no-template/entry.jsonData117 B—
results/post-training/models/gemma-4-e2b-it-no-template/probes.jsonData14.4 KB—
results/post-training/models/gemma-4-e2b-it-no-template/recipe.jsonData2.4 KB—
results/post-training/models/gemma-4-e2b-it-no-template/tags.jsonData2.5 KB—
results/post-training/models/gemma-4-e2b-it-no-template/test_metrics.jsonData21.8 KB—
results/post-training/models/gemma-4-e2b-it/coherence.jsonData27.3 KB—
results/post-training/models/gemma-4-e2b-it/entry.jsonData101 B—
results/post-training/models/gemma-4-e2b-it/probes.jsonData14.2 KB—
results/post-training/models/gemma-4-e2b-it/recipe.jsonData2.5 KB—
results/post-training/models/gemma-4-e2b-it/tags.jsonData2.5 KB—
results/post-training/models/gemma-4-e2b-it/test_metrics.jsonData43.7 KB—
results/post-training/models/gemma-4-e2b/coherence.jsonData27.1 KB—
results/post-training/models/gemma-4-e2b/entry.jsonData97 B—
results/post-training/models/gemma-4-e2b/probes.jsonData14.2 KB—
results/post-training/models/gemma-4-e2b/recipe.jsonData2.5 KB—
results/post-training/models/gemma-4-e2b/tags.jsonData2.5 KB—
results/post-training/models/gemma-4-e2b/test_metrics.jsonData30.6 KB—
results/post-training/models/gemma-4-e4b-base-lora-supervised/coherence.jsonData27.4 KB—
results/post-training/models/gemma-4-e4b-base-lora-supervised/entry.jsonData152 B—
results/post-training/models/gemma-4-e4b-base-lora-supervised/probes.jsonData14.3 KB—
results/post-training/models/gemma-4-e4b-base-lora-supervised/recipe.jsonData2.4 KB—
results/post-training/models/gemma-4-e4b-base-lora-supervised/tags.jsonData2.5 KB—
results/post-training/models/gemma-4-e4b-base-lora-supervised/test_metrics.jsonData44.6 KB—
results/post-training/models/gemma-4-e4b-it-lora-coherence/coherence.jsonData27.5 KB—
results/post-training/models/gemma-4-e4b-it-lora-coherence/entry.jsonData149 B—
results/post-training/models/gemma-4-e4b-it-lora-coherence/probes.jsonData14.5 KB—
results/post-training/models/gemma-4-e4b-it-lora-coherence/recipe.jsonData2.4 KB—
results/post-training/models/gemma-4-e4b-it-lora-coherence/tags.jsonData2.6 KB—
results/post-training/models/gemma-4-e4b-it-lora-coherence/test_metrics.jsonData44.4 KB—
results/post-training/models/gemma-4-e4b-it-lora-supervised/coherence.jsonData27.6 KB—
results/post-training/models/gemma-4-e4b-it-lora-supervised/entry.jsonData148 B—
results/post-training/models/gemma-4-e4b-it-lora-supervised/probes.jsonData14.4 KB—
results/post-training/models/gemma-4-e4b-it-lora-supervised/recipe.jsonData2.4 KB—
results/post-training/models/gemma-4-e4b-it-lora-supervised/tags.jsonData2.7 KB—
results/post-training/models/gemma-4-e4b-it-lora-supervised/test_metrics.jsonData44.3 KB—
results/post-training/models/gemma-4-e4b-it-no-template/coherence.jsonData27.4 KB—
results/post-training/models/gemma-4-e4b-it-no-template/entry.jsonData117 B—
results/post-training/models/gemma-4-e4b-it-no-template/probes.jsonData14.2 KB—
results/post-training/models/gemma-4-e4b-it-no-template/recipe.jsonData2.4 KB—
results/post-training/models/gemma-4-e4b-it-no-template/tags.jsonData2.5 KB—
results/post-training/models/gemma-4-e4b-it-no-template/test_metrics.jsonData20.2 KB—
results/post-training/models/gemma-4-e4b-it/coherence.jsonData27.5 KB—
results/post-training/models/gemma-4-e4b-it/entry.jsonData101 B—
results/post-training/models/gemma-4-e4b-it/probes.jsonData14.3 KB—
results/post-training/models/gemma-4-e4b-it/recipe.jsonData2.5 KB—
results/post-training/models/gemma-4-e4b-it/tags.jsonData2.6 KB—
results/post-training/models/gemma-4-e4b-it/test_metrics.jsonData43.0 KB—
results/post-training/models/gemma-4-e4b/coherence.jsonData27.1 KB—
results/post-training/models/gemma-4-e4b/entry.jsonData97 B—
results/post-training/models/gemma-4-e4b/probes.jsonData14.2 KB—
results/post-training/models/gemma-4-e4b/recipe.jsonData2.5 KB—
results/post-training/models/gemma-4-e4b/tags.jsonData2.6 KB—
results/post-training/models/gemma-4-e4b/test_metrics.jsonData35.5 KB—
results/post-training/models/jev-1-13-0-api/coherence.jsonData28.9 KB—
results/post-training/models/jev-1-13-0-api/entry.jsonData92 B—
results/post-training/models/jev-1-13-0-api/probes.jsonData14.1 KB—
results/post-training/models/jev-1-13-0-api/test_metrics.jsonData42.3 KB—
results/post-training/models/llama-3-1-8b-no-template/coherence.jsonData27.1 KB—
results/post-training/models/llama-3-1-8b-no-template/entry.jsonData134 B—
results/post-training/models/llama-3-1-8b-no-template/probes.jsonData14.2 KB—
results/post-training/models/llama-3-1-8b-no-template/recipe.jsonData2.5 KB—
results/post-training/models/llama-3-1-8b-no-template/tags.jsonData2.6 KB—
results/post-training/models/llama-3-1-8b-no-template/test_metrics.jsonData41.1 KB—
results/post-training/models/qwen3-4b-base/coherence.jsonData27.4 KB—
results/post-training/models/qwen3-4b-base/entry.jsonData105 B—
results/post-training/models/qwen3-4b-base/probes.jsonData14.2 KB—
results/post-training/models/qwen3-4b-base/recipe.jsonData2.5 KB—
results/post-training/models/qwen3-4b-base/tags.jsonData2.5 KB—
results/post-training/models/qwen3-4b-base/test_metrics.jsonData44.3 KB—
results/post-training/models/qwen3-4b-instruct-2507/coherence.jsonData27.5 KB—
results/post-training/models/qwen3-4b-instruct-2507/entry.jsonData118 B—
results/post-training/models/qwen3-4b-instruct-2507/probes.jsonData14.3 KB—
results/post-training/models/qwen3-4b-instruct-2507/recipe.jsonData2.5 KB—
results/post-training/models/qwen3-4b-instruct-2507/tags.jsonData2.5 KB—
results/post-training/models/qwen3-4b-instruct-2507/test_metrics.jsonData39.9 KB—
results/post-training/models/qwen3-4b-thinking-2507/coherence.jsonData27.4 KB—
results/post-training/models/qwen3-4b-thinking-2507/entry.jsonData119 B—
results/post-training/models/qwen3-4b-thinking-2507/probes.jsonData14.2 KB—
results/post-training/models/qwen3-4b-thinking-2507/recipe.jsonData2.5 KB—
results/post-training/models/qwen3-4b-thinking-2507/tags.jsonData2.6 KB—
results/post-training/models/qwen3-4b-thinking-2507/test_metrics.jsonData41.4 KB—
results/post-training/models/qwen3-5-2b-base-lora-coherence/coherence.jsonData27.7 KB—
results/post-training/models/qwen3-5-2b-base-lora-coherence/entry.jsonData149 B—
results/post-training/models/qwen3-5-2b-base-lora-coherence/probes.jsonData14.4 KB—
results/post-training/models/qwen3-5-2b-base-lora-coherence/recipe.jsonData2.4 KB—
results/post-training/models/qwen3-5-2b-base-lora-coherence/tags.jsonData2.7 KB—
results/post-training/models/qwen3-5-2b-base-lora-coherence/test_metrics.jsonData43.3 KB—
results/post-training/models/qwen3-5-2b-base-lora-supervised/coherence.jsonData27.4 KB—
results/post-training/models/qwen3-5-2b-base-lora-supervised/entry.jsonData148 B—
results/post-training/models/qwen3-5-2b-base-lora-supervised/probes.jsonData14.4 KB—
results/post-training/models/qwen3-5-2b-base-lora-supervised/recipe.jsonData2.5 KB—
results/post-training/models/qwen3-5-2b-base-lora-supervised/tags.jsonData2.6 KB—
results/post-training/models/qwen3-5-2b-base-lora-supervised/test_metrics.jsonData43.8 KB—
results/post-training/models/qwen3-5-2b-base/coherence.jsonData27.2 KB—
results/post-training/models/qwen3-5-2b-base/entry.jsonData106 B—
results/post-training/models/qwen3-5-2b-base/probes.jsonData14.3 KB—
results/post-training/models/qwen3-5-2b-base/recipe.jsonData2.5 KB—
results/post-training/models/qwen3-5-2b-base/tags.jsonData2.5 KB—
results/post-training/models/qwen3-5-2b-base/test_metrics.jsonData34.4 KB—
results/post-training/models/qwen3-5-2b/coherence.jsonData22.1 KB—
results/post-training/models/qwen3-5-2b/entry.jsonData105 B—
results/post-training/models/qwen3-5-2b/probes.jsonData14.1 KB—
results/post-training/models/qwen3-5-2b/recipe.jsonData2.5 KB—
results/post-training/models/qwen3-5-2b/tags.jsonData2.6 KB—
results/post-training/models/qwen3-5-2b/test_metrics.jsonData43.4 KB—
results/post-training/models/qwen3-5-4b-base-lora-coherence/coherence.jsonData27.6 KB—
results/post-training/models/qwen3-5-4b-base-lora-coherence/entry.jsonData149 B—
results/post-training/models/qwen3-5-4b-base-lora-coherence/probes.jsonData14.3 KB—
results/post-training/models/qwen3-5-4b-base-lora-coherence/recipe.jsonData2.4 KB—
results/post-training/models/qwen3-5-4b-base-lora-coherence/tags.jsonData2.6 KB—
results/post-training/models/qwen3-5-4b-base-lora-coherence/test_metrics.jsonData43.4 KB—
results/post-training/models/qwen3-5-4b-base-lora-supervised/coherence.jsonData27.6 KB—
results/post-training/models/qwen3-5-4b-base-lora-supervised/entry.jsonData148 B—
results/post-training/models/qwen3-5-4b-base-lora-supervised/probes.jsonData14.4 KB—
results/post-training/models/qwen3-5-4b-base-lora-supervised/recipe.jsonData2.5 KB—
results/post-training/models/qwen3-5-4b-base-lora-supervised/tags.jsonData2.5 KB—
results/post-training/models/qwen3-5-4b-base-lora-supervised/test_metrics.jsonData43.3 KB—
results/post-training/models/qwen3-5-4b-base/coherence.jsonData27.5 KB—
results/post-training/models/qwen3-5-4b-base/entry.jsonData106 B—
results/post-training/models/qwen3-5-4b-base/probes.jsonData14.3 KB—
results/post-training/models/qwen3-5-4b-base/recipe.jsonData2.5 KB—
results/post-training/models/qwen3-5-4b-base/tags.jsonData2.6 KB—
results/post-training/models/qwen3-5-4b-base/test_metrics.jsonData43.7 KB—
results/post-training/models/qwen3-5-4b-tier-2-heads-lora/coherence.jsonData22.3 KB—
results/post-training/models/qwen3-5-4b-tier-2-heads-lora/entry.jsonData108 B—
results/post-training/models/qwen3-5-4b-tier-2-heads-lora/test_metrics.jsonData43.7 KB—
results/post-training/models/qwen3-5-4b/coherence.jsonData22.2 KB—
results/post-training/models/qwen3-5-4b/entry.jsonData105 B—
results/post-training/models/qwen3-5-4b/probes.jsonData14.3 KB—
results/post-training/models/qwen3-5-4b/recipe.jsonData2.5 KB—
results/post-training/models/qwen3-5-4b/tags.jsonData2.5 KB—
results/post-training/models/qwen3-5-4b/test_metrics.jsonData44.1 KB—
results/post-training/models/qwen3-5-9b-base/coherence.jsonData27.3 KB—
results/post-training/models/qwen3-5-9b-base/entry.jsonData106 B—
results/post-training/models/qwen3-5-9b-base/probes.jsonData14.3 KB—
results/post-training/models/qwen3-5-9b-base/recipe.jsonData2.5 KB—
results/post-training/models/qwen3-5-9b-base/tags.jsonData2.6 KB—
results/post-training/models/qwen3-5-9b-base/test_metrics.jsonData43.9 KB—
results/post-training/models/qwen3-5-9b/coherence.jsonData22.0 KB—
results/post-training/models/qwen3-5-9b/entry.jsonData105 B—
results/post-training/models/qwen3-5-9b/probes.jsonData14.3 KB—
results/post-training/models/qwen3-5-9b/recipe.jsonData2.4 KB—
results/post-training/models/qwen3-5-9b/tags.jsonData2.5 KB—
results/post-training/models/qwen3-5-9b/test_metrics.jsonData43.9 KB—
results/post-training/models/smollm3-3b-apo-no-template/entry.jsonData114 B—
results/post-training/models/smollm3-3b-apo-no-template/recipe.jsonData2.5 KB—
results/post-training/models/smollm3-3b-apo-no-template/test_metrics.jsonData38.2 KB—
results/post-training/models/smollm3-3b-apo/coherence.jsonData27.2 KB—
results/post-training/models/smollm3-3b-apo/entry.jsonData87 B—
results/post-training/models/smollm3-3b-apo/probes.jsonData14.1 KB—
results/post-training/models/smollm3-3b-apo/recipe.jsonData2.5 KB—
results/post-training/models/smollm3-3b-apo/tags.jsonData2.6 KB—
results/post-training/models/smollm3-3b-apo/test_metrics.jsonData41.4 KB—
results/post-training/models/smollm3-3b-base-no-template/entry.jsonData116 B—
results/post-training/models/smollm3-3b-base-no-template/recipe.jsonData2.4 KB—
results/post-training/models/smollm3-3b-base-no-template/test_metrics.jsonData40.3 KB—
results/post-training/models/smollm3-3b-final-merge-no-template/entry.jsonData134 B—
results/post-training/models/smollm3-3b-final-merge-no-template/recipe.jsonData2.5 KB—
results/post-training/models/smollm3-3b-final-merge-no-template/test_metrics.jsonData38.6 KB—
results/post-training/models/smollm3-3b-final-merge/entry.jsonData107 B—
results/post-training/models/smollm3-3b-final-merge/recipe.jsonData2.4 KB—
results/post-training/models/smollm3-3b-final-merge/test_metrics.jsonData42.0 KB—
results/post-training/models/smollm3-3b-mid-training-no-template/entry.jsonData132 B—
results/post-training/models/smollm3-3b-mid-training-no-template/recipe.jsonData2.5 KB—
results/post-training/models/smollm3-3b-mid-training-no-template/test_metrics.jsonData35.8 KB—
results/post-training/models/smollm3-3b-mid-training/entry.jsonData105 B—
results/post-training/models/smollm3-3b-mid-training/recipe.jsonData2.5 KB—
results/post-training/models/smollm3-3b-mid-training/test_metrics.jsonData32.4 KB—
results/post-training/models/smollm3-3b-sft-no-template/entry.jsonData114 B—
results/post-training/models/smollm3-3b-sft-no-template/recipe.jsonData2.5 KB—
results/post-training/models/smollm3-3b-sft-no-template/test_metrics.jsonData35.8 KB—
results/post-training/models/smollm3-3b-sft/coherence.jsonData27.0 KB—
results/post-training/models/smollm3-3b-sft/entry.jsonData87 B—
results/post-training/models/smollm3-3b-sft/probes.jsonData14.2 KB—
results/post-training/models/smollm3-3b-sft/recipe.jsonData2.5 KB—
results/post-training/models/smollm3-3b-sft/tags.jsonData2.5 KB—
results/post-training/models/smollm3-3b-sft/test_metrics.jsonData41.6 KB—
results/post-training/models/t-lu-3-8b-dpo/coherence.jsonData27.6 KB—
results/post-training/models/t-lu-3-8b-dpo/entry.jsonData112 B—
results/post-training/models/t-lu-3-8b-dpo/probes.jsonData14.3 KB—
results/post-training/models/t-lu-3-8b-dpo/recipe.jsonData2.5 KB—
results/post-training/models/t-lu-3-8b-dpo/tags.jsonData2.5 KB—
results/post-training/models/t-lu-3-8b-dpo/test_metrics.jsonData42.9 KB—
results/post-training/models/t-lu-3-8b-rlvr/coherence.jsonData27.5 KB—
results/post-training/models/t-lu-3-8b-rlvr/entry.jsonData116 B—
results/post-training/models/t-lu-3-8b-rlvr/probes.jsonData14.2 KB—
results/post-training/models/t-lu-3-8b-rlvr/recipe.jsonData2.5 KB—
results/post-training/models/t-lu-3-8b-rlvr/tags.jsonData2.6 KB—
results/post-training/models/t-lu-3-8b-rlvr/test_metrics.jsonData42.6 KB—
results/post-training/models/t-lu-3-8b-sft-no-template/coherence.jsonData27.4 KB—
results/post-training/models/t-lu-3-8b-sft-no-template/entry.jsonData139 B—
results/post-training/models/t-lu-3-8b-sft-no-template/probes.jsonData14.3 KB—
results/post-training/models/t-lu-3-8b-sft-no-template/recipe.jsonData2.5 KB—
results/post-training/models/t-lu-3-8b-sft-no-template/tags.jsonData2.5 KB—
results/post-training/models/t-lu-3-8b-sft-no-template/test_metrics.jsonData42.9 KB—
results/post-training/models/t-lu-3-8b-sft/coherence.jsonData27.5 KB—
results/post-training/models/t-lu-3-8b-sft/entry.jsonData112 B—
results/post-training/models/t-lu-3-8b-sft/probes.jsonData14.3 KB—
results/post-training/models/t-lu-3-8b-sft/recipe.jsonData2.5 KB—
results/post-training/models/t-lu-3-8b-sft/tags.jsonData2.5 KB—
results/post-training/models/t-lu-3-8b-sft/test_metrics.jsonData43.7 KB—
results/post-training/models/tev1-4b-own-prompt/coherence.jsonData27.6 KB—
results/post-training/models/tev1-4b-own-prompt/entry.jsonData108 B—
results/post-training/models/tev1-4b-own-prompt/probes.jsonData14.3 KB—
results/post-training/models/tev1-4b-own-prompt/recipe.jsonData2.5 KB—
results/post-training/models/tev1-4b-own-prompt/tags.jsonData2.5 KB—
results/post-training/models/tev1-4b-own-prompt/test_metrics.jsonData43.7 KB—
results/post-training/pt.jsonData72.3 KB—
results/pplx-decider-v1-27b/coherence/coherence_as_served.jsonData27.6 KB—
results/pplx-decider-v1-27b/coherence/coherence_our_recipe.jsonData27.8 KB—
results/pplx-decider-v1-27b/item_stats.jsonData14.7 KB—
results/pplx-decider-v1-27b/our-recipe/recipe.jsonData389 B—
results/pplx-decider-v1-27b/our-recipe/test_metrics.jsonData44.1 KB—
results/pplx-decider-v1-27b/test_metrics.jsonData44.6 KB—
results/pplx-decider-v1-27b/test_predictions.jsonlData37.5 MB4870c9f91907
results/pplx-decider-v1-27b/validation_predictions.jsonlData7.3 MB—
results/qwen35-0.8b-base/recipe.jsonData2.5 KB—
results/qwen35-0.8b-base/run.jsonData630 B—
results/qwen35-0.8b-base/run_validation.jsonData641 B—
results/qwen35-0.8b-base/test_metrics.jsonData35.4 KB—
results/qwen35-0.8b-base/test_predictions.jsonlData69.9 MB3c22b9bdaba4
results/qwen35-0.8b/recipe.jsonData2.5 KB—
results/qwen35-0.8b/run.jsonData617 B—
results/qwen35-0.8b/run_validation.jsonData630 B—
results/qwen35-0.8b/test_metrics.jsonData41.0 KB—
results/qwen35-0.8b/test_predictions.jsonlData70.1 MB7fc50cf9fa0e
results/qwen35-2b-t1/run.jsonData635 B—
results/qwen35-2b-t1/summary.jsonData2.2 KB—
results/qwen35-2b-t1/test_metrics.jsonData44.3 KB—
results/qwen35-2b-t1/test_predictions.jsonlData23.7 MB972ac7a6471c
results/qwen35-2b-t1/tier0_fair_recipe.jsonData2.5 KB—
results/qwen35-2b-t1r-e6-s0/run.jsonData591 B—
results/qwen35-2b-t1r-e6-s0/summary.jsonData2.1 KB—
results/qwen35-2b-t1r-e6-s0/test_metrics.jsonData44.1 KB—
results/qwen35-2b-t1r-e6-s0/test_predictions.jsonlData23.7 MB5ae545dd0788
results/qwen35-2b-t1r-e6-s0/tier0_fair_recipe.jsonData2.4 KB—
results/qwen35-2b-t1r-e6-s1/run.jsonData590 B—
results/qwen35-2b-t1r-e6-s1/summary.jsonData2.1 KB—
results/qwen35-2b-t1r-e6-s1/test_metrics.jsonData44.3 KB—
results/qwen35-2b-t1r-e6-s1/test_predictions.jsonlData23.7 MB4c0d212ca38a
results/qwen35-2b-t1r-e6-s1/tier0_fair_recipe.jsonData2.4 KB—
results/qwen35-2b-t1r-e6-s2/run.jsonData591 B—
results/qwen35-2b-t1r-e6-s2/summary.jsonData2.1 KB—
results/qwen35-2b-t1r-e6-s2/test_metrics.jsonData44.5 KB—
results/qwen35-2b-t1r-e6-s2/test_predictions.jsonlData23.7 MB7547065f5790
results/qwen35-2b-t1r-e6-s2/tier0_fair_recipe.jsonData2.4 KB—
results/qwen35-2b-t1r-e6-s3/run.jsonData591 B—
results/qwen35-2b-t1r-e6-s3/summary.jsonData2.1 KB—
results/qwen35-2b-t1r-e6-s3/test_metrics.jsonData44.0 KB—
results/qwen35-2b-t1r-e6-s3/test_predictions.jsonlData23.7 MB31e796aac2b7
results/qwen35-2b-t1r-e6-s3/tier0_fair_recipe.jsonData2.4 KB—
results/qwen35-2b-t1r-e6-s4/run.jsonData591 B—
results/qwen35-2b-t1r-e6-s4/summary.jsonData2.1 KB—
results/qwen35-2b-t1r-e6-s4/test_metrics.jsonData44.3 KB—
results/qwen35-2b-t1r-e6-s4/test_predictions.jsonlData23.7 MBa1644bae78b1
results/qwen35-2b-t1r-e6-s4/tier0_fair_recipe.jsonData2.4 KB—
results/qwen35-2b-t1r-s0/run.jsonData593 B—
results/qwen35-2b-t1r-s0/summary.jsonData2.1 KB—
results/qwen35-2b-t1r-s0/test_metrics.jsonData44.7 KB—
results/qwen35-2b-t1r-s0/test_predictions.jsonlData23.7 MBb94eb7a5a6bf
results/qwen35-2b-t1r-s0/tier0_fair_recipe.jsonData2.4 KB—
results/qwen35-2b-t1r-s1/run.jsonData589 B—
results/qwen35-2b-t1r-s1/summary.jsonData2.1 KB—
results/qwen35-2b-t1r-s1/test_metrics.jsonData44.6 KB—
results/qwen35-2b-t1r-s1/test_predictions.jsonlData23.7 MBe83afd15be5d
results/qwen35-2b-t1r-s1/tier0_fair_recipe.jsonData2.4 KB—
results/qwen35-2b-t1r-s2/run.jsonData590 B—
results/qwen35-2b-t1r-s2/summary.jsonData2.1 KB—
results/qwen35-2b-t1r-s2/test_metrics.jsonData44.0 KB—
results/qwen35-2b-t1r-s2/test_predictions.jsonlData23.8 MB0c812688be0e
results/qwen35-2b-t1r-s2/tier0_fair_recipe.jsonData2.4 KB—
results/qwen35-2b-t1r-s3/run.jsonData589 B—
results/qwen35-2b-t1r-s3/summary.jsonData2.1 KB—
results/qwen35-2b-t1r-s3/test_metrics.jsonData43.7 KB—
results/qwen35-2b-t1r-s3/test_predictions.jsonlData23.7 MB9b5c3cd5aee4
results/qwen35-2b-t1r-s3/tier0_fair_recipe.jsonData2.4 KB—
results/qwen35-2b-t1r-s4/run.jsonData589 B—
results/qwen35-2b-t1r-s4/summary.jsonData2.1 KB—
results/qwen35-2b-t1r-s4/test_metrics.jsonData43.7 KB—
results/qwen35-2b-t1r-s4/test_predictions.jsonlData23.7 MBce895f4840d4
results/qwen35-2b-t1r-s4/tier0_fair_recipe.jsonData2.4 KB—
results/qwen35-2b-t1r/run.jsonData706 B—
results/qwen35-2b-t1r/summary.jsonData2.3 KB—
results/qwen35-2b-t1r/test_metrics.jsonData46.7 KB—
results/qwen35-2b-t1r/test_predictions.jsonlData23.7 MB8412dd77ce48
results/qwen35-2b-t1r/tier0_fair_recipe.jsonData2.5 KB—
results/qwen35-2b-t2-lowlr-s1/run.jsonData628 B—
results/qwen35-2b-t2-lowlr-s1/summary.jsonData2.2 KB—
results/qwen35-2b-t2-lowlr-s1/test_metrics.jsonData42.2 KB—
results/qwen35-2b-t2-lowlr-s1/test_predictions.jsonlData23.8 MBa969f5c300b7
results/qwen35-2b-t2-lowlr-s1/tier0_fair_recipe.jsonData2.4 KB—
results/qwen35-2b-t2-lowlr-s2/run.jsonData627 B—
results/qwen35-2b-t2-lowlr-s2/summary.jsonData2.2 KB—
results/qwen35-2b-t2-lowlr-s2/test_metrics.jsonData43.5 KB—
results/qwen35-2b-t2-lowlr-s2/test_predictions.jsonlData23.8 MB1bdb98bf7ce7
results/qwen35-2b-t2-lowlr-s2/tier0_fair_recipe.jsonData2.4 KB—
results/qwen35-2b-t2-lowlr-soft/run.jsonData629 B—
results/qwen35-2b-t2-lowlr-soft/summary.jsonData2.2 KB—
results/qwen35-2b-t2-lowlr-soft/test_metrics.jsonData42.9 KB—
results/qwen35-2b-t2-lowlr-soft/test_predictions.jsonlData23.8 MB96c92dec758f
results/qwen35-2b-t2-lowlr-soft/tier0_fair_recipe.jsonData3.1 KB—
results/qwen35-2b-t2-lowlr/run.jsonData613 B—
results/qwen35-2b-t2-lowlr/summary.jsonData2.2 KB—
results/qwen35-2b-t2-lowlr/test_metrics.jsonData43.2 KB—
results/qwen35-2b-t2-lowlr/test_predictions.jsonlData23.8 MB15938b2b1bc3
results/qwen35-2b-t2-lowlr/tier0_fair_recipe.jsonData2.4 KB—
results/qwen35-2b-t2-s1/run.jsonData623 B—
results/qwen35-2b-t2-s1/summary.jsonData2.2 KB—
results/qwen35-2b-t2-s1/test_metrics.jsonData42.1 KB—
results/qwen35-2b-t2-s1/test_predictions.jsonlData23.8 MB05b332053234
results/qwen35-2b-t2-s1/tier0_fair_recipe.jsonData2.4 KB—
results/qwen35-2b-t2-s2/run.jsonData622 B—
results/qwen35-2b-t2-s2/summary.jsonData2.2 KB—
results/qwen35-2b-t2-s2/test_metrics.jsonData43.3 KB—
results/qwen35-2b-t2-s2/test_predictions.jsonlData23.8 MBe64487c682a3
results/qwen35-2b-t2-s2/tier0_fair_recipe.jsonData2.4 KB—
results/qwen35-2b-t2-soft/run.jsonData612 B—
results/qwen35-2b-t2-soft/summary.jsonData2.2 KB—
results/qwen35-2b-t2-soft/test_metrics.jsonData42.7 KB—
results/qwen35-2b-t2-soft/test_predictions.jsonlData23.8 MB57ab008fe7db
results/qwen35-2b-t2-soft/tier0_fair_recipe.jsonData2.4 KB—
results/qwen35-2b-t2/run.jsonData584 B—
results/qwen35-2b-t2/summary.jsonData2.1 KB—
results/qwen35-2b-t2/test_metrics.jsonData43.0 KB—
results/qwen35-2b-t2/test_predictions.jsonlData23.8 MB5caf81a1f26c
results/qwen35-2b-t2/tier0_fair_recipe.jsonData2.4 KB—
results/qwen35-2b/recipe.jsonData2.5 KB—
results/qwen35-2b/run.jsonData663 B—
results/qwen35-2b/run_validation.jsonData677 B—
results/qwen35-2b/test_metrics.jsonData43.4 KB—
results/qwen35-2b/test_predictions.jsonlData69.5 MBe6cae5a3593b
results/qwen35-4b-t1r-s1/run.jsonData591 B—
results/qwen35-4b-t1r-s1/summary.jsonData2.1 KB—
results/qwen35-4b-t1r-s1/test_metrics.jsonData45.3 KB—
results/qwen35-4b-t1r-s1/test_predictions.jsonlData23.7 MBa54b9a04f03d
results/qwen35-4b-t1r-s1/tier0_fair_recipe.jsonData2.4 KB—
results/qwen35-4b-t1r-s2/run.jsonData589 B—
results/qwen35-4b-t1r-s2/summary.jsonData2.1 KB—
results/qwen35-4b-t1r-s2/test_metrics.jsonData44.6 KB—
results/qwen35-4b-t1r-s2/test_predictions.jsonlData23.8 MB46c525b7e721
results/qwen35-4b-t1r-s2/tier0_fair_recipe.jsonData2.4 KB—
results/qwen35-4b-t1r-s3/run.jsonData589 B—
results/qwen35-4b-t1r-s3/summary.jsonData2.1 KB—
results/qwen35-4b-t1r-s3/test_metrics.jsonData44.6 KB—
results/qwen35-4b-t1r-s3/test_predictions.jsonlData23.8 MB2fdd0d8022ec
results/qwen35-4b-t1r-s3/tier0_fair_recipe.jsonData2.4 KB—
results/qwen35-4b-t1r-s4/run.jsonData590 B—
results/qwen35-4b-t1r-s4/summary.jsonData2.1 KB—
results/qwen35-4b-t1r-s4/test_metrics.jsonData44.8 KB—
results/qwen35-4b-t1r-s4/test_predictions.jsonlData23.8 MB3c42d8236e5e
results/qwen35-4b-t1r-s4/tier0_fair_recipe.jsonData2.4 KB—
results/qwen35-4b-t1r/run.jsonData708 B—
results/qwen35-4b-t1r/summary.jsonData2.3 KB—
results/qwen35-4b-t1r/test_metrics.jsonData47.4 KB—
results/qwen35-4b-t1r/test_predictions.jsonlData23.8 MB81f9ab971e78
results/qwen35-4b-t1r/tier0_fair_recipe.jsonData2.5 KB—
results/qwen35-4b-t2-lowlr/run.jsonData626 B—
results/qwen35-4b-t2-lowlr/summary.jsonData2.2 KB—
results/qwen35-4b-t2-lowlr/test_metrics.jsonData43.7 KB—
results/qwen35-4b-t2-lowlr/test_predictions.jsonlData23.8 MB4e99793dcceb
results/qwen35-4b-t2-lowlr/tier0_fair_recipe.jsonData3.0 KB—
results/qwen35-4b-t2/run.jsonData586 B—
results/qwen35-4b-t2/summary.jsonData2.1 KB—
results/qwen35-4b-t2/test_metrics.jsonData40.7 KB—
results/qwen35-4b-t2/test_predictions.jsonlData23.8 MB62f0a13a65bc
results/qwen35-4b-t2/tier0_fair_recipe.jsonData2.4 KB—
results/qwen35-4b-tev1fmt/recipe.jsonData2.5 KB—
results/qwen35-4b-tev1fmt/run.jsonData689 B—
results/qwen35-4b-tev1fmt/run_validation.jsonData702 B—
results/qwen35-4b-tev1fmt/test_metrics.jsonData44.9 KB—
results/qwen35-4b-tev1fmt/test_predictions.jsonlData70.7 MBd3ea01859a95
results/qwen35-4b/recipe.jsonData2.5 KB—
results/qwen35-4b/run.jsonData664 B—
results/qwen35-4b/run_validation.jsonData666 B—
results/qwen35-4b/test_metrics.jsonData44.1 KB—
results/qwen35-4b/test_predictions.jsonlData69.7 MBccb861d72698
results/qwen35-9b-t1r-s0/run.jsonData592 B—
results/qwen35-9b-t1r-s0/summary.jsonData2.1 KB—
results/qwen35-9b-t1r-s0/test_metrics.jsonData44.5 KB—
results/qwen35-9b-t1r-s0/test_predictions.jsonlData23.8 MB6e17cb78aa3a
results/qwen35-9b-t1r-s0/tier0_fair_recipe.jsonData3.0 KB—
results/qwen35-9b-t1r-s1/run.jsonData585 B—
results/qwen35-9b-t1r-s1/summary.jsonData2.1 KB—
results/qwen35-9b-t1r-s1/test_metrics.jsonData44.8 KB—
results/qwen35-9b-t1r-s1/test_predictions.jsonlData23.8 MBb01c71c48147
results/qwen35-9b-t1r-s1/tier0_fair_recipe.jsonData3.0 KB—
results/qwen35-9b-t1r-s2/run.jsonData587 B—
results/qwen35-9b-t1r-s2/summary.jsonData2.1 KB—
results/qwen35-9b-t1r-s2/test_metrics.jsonData44.2 KB—
results/qwen35-9b-t1r-s2/test_predictions.jsonlData23.8 MBacb1c24c8e99
results/qwen35-9b-t1r-s2/tier0_fair_recipe.jsonData3.0 KB—
results/qwen35-9b-vision/recipe.jsonData1.2 KB—
results/qwen35-9b-vision/run.jsonData1.1 KB—
results/qwen35-9b-vision/test_metrics.jsonData5.8 KB—
results/qwen35-9b-vision/test_predictions.jsonlData1.8 MB—
results/qwen35-9b-vision/test_records.jsonlData2.6 MB—
results/qwen35-9b/recipe.jsonData2.4 KB—
results/qwen35-9b/run.jsonData621 B—
results/qwen35-9b/run_validation.jsonData636 B—
results/qwen35-9b/test_metrics.jsonData43.9 KB—
results/qwen35-9b/test_predictions.jsonlData69.5 MB187529ca078b
results/qwen3vl-2b-t2-both/lora/adapter_config.jsonData1.2 KB—
results/qwen3vl-2b-t2-both/recipe.jsonData1.2 KB—
results/qwen3vl-2b-t2-both/run.jsonData1.8 KB—
results/qwen3vl-2b-t2-both/test_metrics.jsonData6.0 KB—
results/qwen3vl-2b-t2-both/test_predictions.jsonlData1.8 MB—
results/qwen3vl-2b-t2-both/test_records.jsonlData2.6 MB—
results/qwen3vl-2b-t2-decoder/lora/adapter_config.jsonData1.2 KB—
results/qwen3vl-2b-t2-decoder/recipe.jsonData1.2 KB—
results/qwen3vl-2b-t2-decoder/run.jsonData1.8 KB—
results/qwen3vl-2b-t2-decoder/test_metrics.jsonData6.0 KB—
results/qwen3vl-2b-t2-decoder/test_predictions.jsonlData1.8 MB—
results/qwen3vl-2b-t2-decoder/test_records.jsonlData2.6 MB—
results/qwen3vl-2b-t2-vision/lora/adapter_config.jsonData1.1 KB—
results/qwen3vl-2b-t2-vision/recipe.jsonData1.2 KB—
results/qwen3vl-2b-t2-vision/run.jsonData1.8 KB—
results/qwen3vl-2b-t2-vision/test_metrics.jsonData6.0 KB—
results/qwen3vl-2b-t2-vision/test_predictions.jsonlData1.8 MB—
results/qwen3vl-2b-t2-vision/test_records.jsonlData2.6 MB—
results/qwen3vl-2b/recipe.jsonData1.2 KB—
results/qwen3vl-2b/run.jsonData338 B—
results/qwen3vl-2b/test_metrics.jsonData5.9 KB—
results/qwen3vl-2b/test_predictions.jsonlData1.8 MB—
results/qwen3vl-2b/test_records.jsonlData2.6 MB—
results/qwen3vl-8b/recipe.jsonData1.2 KB—
results/qwen3vl-8b/run.jsonData1.1 KB—
results/qwen3vl-8b/test_metrics.jsonData5.9 KB—
results/qwen3vl-8b/test_predictions.jsonlData1.8 MB—
results/qwen3vl-8b/test_records.jsonlData2.6 MB—
results/recipe-k/recipe_k.jsonData34.5 KB—
results/smollm3-3b/recipe.jsonData2.4 KB—
results/smollm3-3b/run.jsonData671 B—
results/smollm3-3b/run_validation.jsonData687 B—
results/smollm3-3b/test_metrics.jsonData42.0 KB—
results/smollm3-3b/test_predictions.jsonlData69.9 MB64e8e84b84cf
results/tev1-4b-jevfmt/recipe.jsonData2.5 KB—
results/tev1-4b-jevfmt/run.jsonData745 B—
results/tev1-4b-jevfmt/run_validation.jsonData757 B—
results/tev1-4b-jevfmt/test_metrics.jsonData43.9 KB—
results/tev1-4b-jevfmt/test_predictions.jsonlData70.0 MBe87bb29a78e9
results/tev1-4b/recipe.jsonData2.5 KB—
results/tev1-4b/run.jsonData758 B—
results/tev1-4b/run_validation.jsonData769 B—
results/tev1-4b/test_metrics.jsonData43.7 KB—
results/tev1-4b/test_predictions.jsonlData71.2 MB353995b98042
results/tev1-comparison/comparison.jsonData35.6 KB—
results/vision-budget/results.jsonData3.7 KB—
README.mdDocumentation47.9 KB—
results/README.mdDocumentation7.3 KB—
results/b/README.mdDocumentation4.9 KB—
results/b/tables.mdDocumentation3.1 KB—
results/c/README.mdDocumentation3.8 KB—
results/c/b/tables.mdDocumentation2.9 KB—
results/c/community/tables.mdDocumentation6.4 KB—
results/c/jev-bench/comparison.mdDocumentation4.2 KB—
results/c/runs/qwen35-4b-t2-lowlr-rerun/test_report.mdDocumentation2.5 KB—
results/c/runs/qwen35-4b-t2-lowlr-shuf/test_report.mdDocumentation2.5 KB—
results/c/runs/qwen35-4b-t2-lowlr-tev1syn-shuf/test_report.mdDocumentation2.5 KB—
results/c/runs/qwen35-4b-t2-lowlr-tev1syn/test_report.mdDocumentation2.5 KB—
results/clm-8b/test_report.mdDocumentation2.5 KB—
results/clm-8b/vs_jev/compare.mdDocumentation1.9 KB—
results/community/tables.mdDocumentation8.3 KB—
results/figures/vision_lora_scopes.mdDocumentation497 B—
results/gemma4-12b-vision/ablation.mdDocumentation1.0 KB—
results/gemma4-12b-vision/test_report.mdDocumentation496 B—
results/gemma4-12b/ablation.mdDocumentation1.1 KB—
results/gemma4-12b/test_report.mdDocumentation2.5 KB—
results/gemma4-12b/vs_jev/compare.mdDocumentation2.0 KB—
results/gemma4-e2b-it/ablation.mdDocumentation1.1 KB—
results/gemma4-e2b-it/test_report.mdDocumentation2.5 KB—
results/gemma4-e2b-it/vs_jev/compare.mdDocumentation2.0 KB—
results/gemma4-e2b/ablation.mdDocumentation1.1 KB—
results/gemma4-e2b/test_report.mdDocumentation2.5 KB—
results/gemma4-e2b/vs_jev/compare.mdDocumentation2.0 KB—
results/gemma4-e4b-it/ablation.mdDocumentation1.1 KB—
results/gemma4-e4b-it/test_report.mdDocumentation2.5 KB—
results/gemma4-e4b-it/vs_jev/compare.mdDocumentation2.0 KB—
results/jev-1.13.0/README.mdDocumentation7.7 KB—
results/jev-1.13.0/probes/README.mdDocumentation4.8 KB—
results/jev-1.13.0/probes/probes.mdDocumentation5.7 KB—
results/jev-1.13.0/test_report.mdDocumentation2.5 KB—
results/jev-latency-probe/README.mdDocumentation4.7 KB—
results/k2-horizon-0.9b/ablation.mdDocumentation1.1 KB—
results/k2-horizon-0.9b/test_report.mdDocumentation2.5 KB—
results/k2-horizon-0.9b/vs_jev/compare.mdDocumentation2.0 KB—
results/k2-horizon-7b/ablation.mdDocumentation1.1 KB—
results/k2-horizon-7b/test_report.mdDocumentation2.5 KB—
results/k2-horizon-7b/vs_jev/compare.mdDocumentation2.0 KB—
results/latency/latency.mdDocumentation1.7 KB—
results/latency/latency_8b.mdDocumentation712 B—
results/latency/latency_8b_vllm.mdDocumentation607 B—
results/latency/latency_generate_gemma4-12b-vision.mdDocumentation626 B—
results/latency/latency_generate_gemma4-12b.mdDocumentation721 B—
results/latency/latency_generate_qwen35-9b-vision.mdDocumentation620 B—
results/latency/latency_generate_qwen35-9b.mdDocumentation708 B—
results/latency/latency_generate_qwen3vl-8b.mdDocumentation630 B—
results/latency/latency_vision.mdDocumentation520 B—
results/latency/latency_vision_gemma4-12b-vision.mdDocumentation514 B—
results/latency/latency_vision_qwen35-9b-vision.mdDocumentation514 B—
results/latency/latency_vision_qwen3vl-8b.mdDocumentation524 B—
results/latency/latency_vllm.mdDocumentation1.2 KB—
results/latency/latency_vllm_statelast.mdDocumentation741 B—
results/leaderboard/leaderboard.mdDocumentation5.6 KB—
results/phishing-recalibration/README.mdDocumentation2.9 KB—
results/phishing-recalibration/tables.mdDocumentation6.9 KB—
results/post-training/README.mdDocumentation5.0 KB—
results/post-training/pt.mdDocumentation22.5 KB—
results/pplx-decider-v1-27b/README.mdDocumentation7.5 KB—
results/pplx-decider-v1-27b/our-recipe/test_report.mdDocumentation2.5 KB—
results/pplx-decider-v1-27b/test_report.mdDocumentation2.5 KB—
results/qwen35-0.8b-base/ablation.mdDocumentation1.1 KB—
results/qwen35-0.8b-base/test_report.mdDocumentation2.5 KB—
results/qwen35-0.8b-base/vs_jev/compare.mdDocumentation2.0 KB—
results/qwen35-0.8b/ablation.mdDocumentation1.1 KB—
results/qwen35-0.8b/test_report.mdDocumentation2.5 KB—
results/qwen35-0.8b/vs_jev/compare.mdDocumentation2.0 KB—
results/qwen35-2b-t1/test_report.mdDocumentation2.5 KB—
results/qwen35-2b-t1/tier1_report.mdDocumentation3.4 KB—
results/qwen35-2b-t1r-e6-s0/test_report.mdDocumentation2.5 KB—
results/qwen35-2b-t1r-e6-s0/tier1_report.mdDocumentation3.3 KB—
results/qwen35-2b-t1r-e6-s1/test_report.mdDocumentation2.5 KB—
results/qwen35-2b-t1r-e6-s1/tier1_report.mdDocumentation3.3 KB—
results/qwen35-2b-t1r-e6-s2/test_report.mdDocumentation2.5 KB—
results/qwen35-2b-t1r-e6-s2/tier1_report.mdDocumentation3.3 KB—
results/qwen35-2b-t1r-e6-s3/test_report.mdDocumentation2.5 KB—
results/qwen35-2b-t1r-e6-s3/tier1_report.mdDocumentation3.3 KB—
results/qwen35-2b-t1r-e6-s4/test_report.mdDocumentation2.5 KB—
results/qwen35-2b-t1r-e6-s4/tier1_report.mdDocumentation3.3 KB—
results/qwen35-2b-t1r-s0/test_report.mdDocumentation2.5 KB—
results/qwen35-2b-t1r-s0/tier1_report.mdDocumentation3.4 KB—
results/qwen35-2b-t1r-s1/test_report.mdDocumentation2.5 KB—
results/qwen35-2b-t1r-s1/tier1_report.mdDocumentation3.4 KB—
results/qwen35-2b-t1r-s2/test_report.mdDocumentation2.5 KB—
results/qwen35-2b-t1r-s2/tier1_report.mdDocumentation3.4 KB—
results/qwen35-2b-t1r-s3/test_report.mdDocumentation2.5 KB—
results/qwen35-2b-t1r-s3/tier1_report.mdDocumentation3.4 KB—
results/qwen35-2b-t1r-s4/test_report.mdDocumentation2.5 KB—
results/qwen35-2b-t1r-s4/tier1_report.mdDocumentation3.4 KB—
results/qwen35-2b-t1r/test_report.mdDocumentation2.5 KB—
results/qwen35-2b-t1r/tier1_report.mdDocumentation3.4 KB—
results/qwen35-2b-t2-lowlr-s1/test_report.mdDocumentation2.5 KB—
results/qwen35-2b-t2-lowlr-s1/tier1_report.mdDocumentation3.4 KB—
results/qwen35-2b-t2-lowlr-s2/test_report.mdDocumentation2.5 KB—
results/qwen35-2b-t2-lowlr-s2/tier1_report.mdDocumentation3.4 KB—
results/qwen35-2b-t2-lowlr-soft/test_report.mdDocumentation2.5 KB—
results/qwen35-2b-t2-lowlr-soft/tier1_report.mdDocumentation3.4 KB—
results/qwen35-2b-t2-lowlr/test_report.mdDocumentation2.5 KB—
results/qwen35-2b-t2-lowlr/tier1_report.mdDocumentation3.4 KB—
results/qwen35-2b-t2-s1/test_report.mdDocumentation2.5 KB—
results/qwen35-2b-t2-s1/tier1_report.mdDocumentation3.4 KB—
results/qwen35-2b-t2-s2/test_report.mdDocumentation2.5 KB—
results/qwen35-2b-t2-s2/tier1_report.mdDocumentation3.4 KB—
results/qwen35-2b-t2-soft/test_report.mdDocumentation2.5 KB—
results/qwen35-2b-t2-soft/tier1_report.mdDocumentation3.4 KB—
results/qwen35-2b-t2/test_report.mdDocumentation2.5 KB—
results/qwen35-2b-t2/tier1_report.mdDocumentation3.3 KB—
results/qwen35-2b/ablation.mdDocumentation1.1 KB—
results/qwen35-2b/test_report.mdDocumentation2.5 KB—
results/qwen35-2b/vs_jev/compare.mdDocumentation2.0 KB—
results/qwen35-4b-t1r-s1/test_report.mdDocumentation2.5 KB—
results/qwen35-4b-t1r-s1/tier1_report.mdDocumentation3.3 KB—
results/qwen35-4b-t1r-s2/test_report.mdDocumentation2.5 KB—
results/qwen35-4b-t1r-s2/tier1_report.mdDocumentation3.3 KB—
results/qwen35-4b-t1r-s3/test_report.mdDocumentation2.5 KB—
results/qwen35-4b-t1r-s3/tier1_report.mdDocumentation3.3 KB—
results/qwen35-4b-t1r-s4/test_report.mdDocumentation2.5 KB—
results/qwen35-4b-t1r-s4/tier1_report.mdDocumentation3.3 KB—
results/qwen35-4b-t1r/test_report.mdDocumentation2.5 KB—
results/qwen35-4b-t1r/tier1_report.mdDocumentation3.4 KB—
results/qwen35-4b-t2-lowlr/test_report.mdDocumentation2.5 KB—
results/qwen35-4b-t2-lowlr/tier1_report.mdDocumentation3.4 KB—
results/qwen35-4b-t2/test_report.mdDocumentation2.5 KB—
results/qwen35-4b-t2/tier1_report.mdDocumentation3.3 KB—
results/qwen35-4b-tev1fmt/ablation.mdDocumentation1.1 KB—
results/qwen35-4b-tev1fmt/test_report.mdDocumentation2.5 KB—
results/qwen35-4b-tev1fmt/vs_jev/compare.mdDocumentation2.0 KB—
results/qwen35-4b/ablation.mdDocumentation1.1 KB—
results/qwen35-4b/test_report.mdDocumentation2.5 KB—
results/qwen35-4b/vs_jev/compare.mdDocumentation2.0 KB—
results/qwen35-9b-t1r-s0/test_report.mdDocumentation2.5 KB—
results/qwen35-9b-t1r-s0/tier1_report.mdDocumentation3.3 KB—
results/qwen35-9b-t1r-s1/test_report.mdDocumentation2.5 KB—
results/qwen35-9b-t1r-s1/tier1_report.mdDocumentation3.3 KB—
results/qwen35-9b-t1r-s2/test_report.mdDocumentation2.5 KB—
results/qwen35-9b-t1r-s2/tier1_report.mdDocumentation3.3 KB—
results/qwen35-9b-vision/ablation.mdDocumentation1.0 KB—
results/qwen35-9b-vision/test_report.mdDocumentation490 B—
results/qwen35-9b/ablation.mdDocumentation1.1 KB—
results/qwen35-9b/test_report.mdDocumentation2.5 KB—
results/qwen35-9b/vs_jev/compare.mdDocumentation2.0 KB—
results/qwen3vl-2b-t2-both/ablation.mdDocumentation1.0 KB—
results/qwen3vl-2b-t2-both/lora/README.mdDocumentation5.2 KB—
results/qwen3vl-2b-t2-both/test_report.mdDocumentation511 B—
results/qwen3vl-2b-t2-decoder/ablation.mdDocumentation996 B—
results/qwen3vl-2b-t2-decoder/lora/README.mdDocumentation5.2 KB—
results/qwen3vl-2b-t2-decoder/test_report.mdDocumentation514 B—
results/qwen3vl-2b-t2-vision/ablation.mdDocumentation998 B—
results/qwen3vl-2b-t2-vision/lora/README.mdDocumentation5.2 KB—
results/qwen3vl-2b-t2-vision/test_report.mdDocumentation513 B—
results/qwen3vl-2b/ablation.mdDocumentation1.0 KB—
results/qwen3vl-2b/test_report.mdDocumentation500 B—
results/qwen3vl-8b/ablation.mdDocumentation1.0 KB—
results/qwen3vl-8b/test_report.mdDocumentation500 B—
results/recipe-k/recipe_k.mdDocumentation1.7 KB—
results/smollm3-3b/ablation.mdDocumentation1.1 KB—
results/smollm3-3b/test_report.mdDocumentation2.5 KB—
results/smollm3-3b/vs_jev/compare.mdDocumentation2.0 KB—
results/tev1-4b-jevfmt/ablation.mdDocumentation1.1 KB—
results/tev1-4b-jevfmt/test_report.mdDocumentation2.5 KB—
results/tev1-4b-jevfmt/vs_jev/compare.mdDocumentation2.1 KB—
results/tev1-4b/ablation.mdDocumentation1.1 KB—
results/tev1-4b/test_report.mdDocumentation2.5 KB—
results/tev1-4b/vs_jev/compare.mdDocumentation2.1 KB—
results/tev1-comparison/comparison.mdDocumentation6.0 KB—
results/vision-budget/README.mdDocumentation728 B—
results/clm-8b/figures/calibration_map.pngOther162.2 KB7aac09bcbffe
results/clm-8b/figures/calibration_map.svgOther34.8 KB—
results/clm-8b/figures/human_vs_model.pngOther367.4 KB30ba257de24b
results/clm-8b/figures/human_vs_model.svgOther4.2 MB—
results/clm-8b/figures/latency.pngOther80.1 KBff7bec260a43
results/clm-8b/figures/latency.svgOther26.3 KB—
results/clm-8b/figures/reliability.pngOther497.6 KB8f9392874ba7
results/clm-8b/figures/reliability.svgOther236.0 KB—
results/clm-8b/figures/risk_coverage.pngOther267.6 KBf9fcec0f88cd
results/clm-8b/figures/risk_coverage.svgOther191.2 KB—
results/clm-8b/figures/vs_cardinality.pngOther160.3 KB4d816a65dfdf
results/clm-8b/figures/vs_cardinality.svgOther44.7 KB—
results/clm-8b/vs_jev/compare_accuracy.pngOther114.4 KB209366bc39ad
results/clm-8b/vs_jev/compare_accuracy.svgOther29.3 KB—
results/clm-8b/vs_jev/compare_ece.pngOther120.8 KB2f2e08dd710b
results/clm-8b/vs_jev/compare_ece.svgOther30.4 KB—
results/community/community.pngOther157.2 KB8394a21f436b
results/community/community.svgOther40.2 KB—
results/figures/confidence_vs_agreement.pngOther229.0 KB2058c069cd59
results/figures/confidence_vs_agreement.svgOther200.0 KB—
results/figures/instruct_vs_base.pngOther107.0 KB4e8b297b02f5
results/figures/instruct_vs_base.svgOther18.2 KB—
results/figures/recipe_ladder.pngOther299.3 KBc9666930e38e
results/figures/recipe_ladder.svgOther43.7 KB—
results/figures/tier1_per_source.pngOther160.8 KB7178bd55fbf1
results/figures/tier1_per_source.svgOther30.5 KB—
results/figures/tier1_story.pngOther174.5 KBfd84ab9d9485
results/figures/tier1_story.svgOther22.4 KB—
results/figures/vision_lora_scopes.pngOther197.3 KBb86e63ee0d9a
results/figures/vision_lora_scopes.svgOther25.6 KB—
results/gemma4-12b-vision/figures/calibration_map.pngOther126.3 KBe7bd2f899093
results/gemma4-12b-vision/figures/calibration_map.svgOther18.0 KB—
results/gemma4-12b-vision/figures/latency.pngOther84.4 KB55a156485a37
results/gemma4-12b-vision/figures/latency.svgOther25.8 KB—
results/gemma4-12b-vision/figures/reliability.pngOther127.0 KB78cf8e165c0e
results/gemma4-12b-vision/figures/reliability.svgOther37.3 KB—
results/gemma4-12b-vision/figures/risk_coverage.pngOther154.2 KB64ed27fe2a96
results/gemma4-12b-vision/figures/risk_coverage.svgOther49.1 KB—
results/gemma4-12b-vision/figures/vs_cardinality.pngOther119.0 KB9c56e7cfb06c
results/gemma4-12b-vision/figures/vs_cardinality.svgOther32.0 KB—
results/gemma4-12b/figures/calibration_map.pngOther179.6 KBfa44ff0bfc03
results/gemma4-12b/figures/calibration_map.svgOther35.4 KB—
results/gemma4-12b/figures/human_vs_model.pngOther393.0 KB449e47bacaac
results/gemma4-12b/figures/human_vs_model.svgOther4.2 MB—
results/gemma4-12b/figures/latency.pngOther85.3 KBd5a3fc67e5d7
results/gemma4-12b/figures/latency.svgOther25.9 KB—
results/gemma4-12b/figures/reliability.pngOther504.9 KBac240287be5e
results/gemma4-12b/figures/reliability.svgOther239.9 KB—
results/gemma4-12b/figures/risk_coverage.pngOther283.6 KBcb6ba9272d8c
results/gemma4-12b/figures/risk_coverage.svgOther198.2 KB—
results/gemma4-12b/figures/vs_cardinality.pngOther166.6 KBdb41eaa07ba0
results/gemma4-12b/figures/vs_cardinality.svgOther45.3 KB—
results/gemma4-12b/vs_jev/compare_accuracy.pngOther119.1 KBc8ed7c0bacce
results/gemma4-12b/vs_jev/compare_accuracy.svgOther29.3 KB—
results/gemma4-12b/vs_jev/compare_ece.pngOther130.6 KB9a47300d4fd3
results/gemma4-12b/vs_jev/compare_ece.svgOther31.2 KB—
results/gemma4-e2b-it/figures/calibration_map.pngOther177.2 KB85fccb952e11
results/gemma4-e2b-it/figures/calibration_map.svgOther36.5 KB—
results/gemma4-e2b-it/figures/human_vs_model.pngOther391.0 KB59f89db324b8
results/gemma4-e2b-it/figures/human_vs_model.svgOther4.2 MB—
results/gemma4-e2b-it/figures/latency.pngOther83.2 KB38295a53771f
results/gemma4-e2b-it/figures/latency.svgOther25.8 KB—
results/gemma4-e2b-it/figures/reliability.pngOther519.1 KBe06bafe0bbf0
results/gemma4-e2b-it/figures/reliability.svgOther249.6 KB—
results/gemma4-e2b-it/figures/risk_coverage.pngOther285.8 KB7e4b8d6bf0e1
results/gemma4-e2b-it/figures/risk_coverage.svgOther244.4 KB—
results/gemma4-e2b-it/figures/vs_cardinality.pngOther166.7 KB871939e00b98
results/gemma4-e2b-it/figures/vs_cardinality.svgOther45.2 KB—
results/gemma4-e2b-it/vs_jev/compare_accuracy.pngOther118.9 KB0f1925f36b9f
results/gemma4-e2b-it/vs_jev/compare_accuracy.svgOther29.3 KB—
results/gemma4-e2b-it/vs_jev/compare_ece.pngOther130.7 KBce194c3a768a
results/gemma4-e2b-it/vs_jev/compare_ece.svgOther31.2 KB—
results/gemma4-e2b/figures/calibration_map.pngOther173.5 KB13959f59bb68
results/gemma4-e2b/figures/calibration_map.svgOther35.5 KB—
results/gemma4-e2b/figures/human_vs_model.pngOther337.1 KBcedd4b097bf7
results/gemma4-e2b/figures/human_vs_model.svgOther4.2 MB—
results/gemma4-e2b/figures/latency.pngOther86.1 KB42608b90d502
results/gemma4-e2b/figures/latency.svgOther26.4 KB—
results/gemma4-e2b/figures/reliability.pngOther461.0 KBa25c7a79215f
results/gemma4-e2b/figures/reliability.svgOther179.6 KB—
results/gemma4-e2b/figures/risk_coverage.pngOther278.2 KB9c5825aaa146
results/gemma4-e2b/figures/risk_coverage.svgOther222.4 KB—
results/gemma4-e2b/figures/vs_cardinality.pngOther161.8 KB542b19fae2fa
results/gemma4-e2b/figures/vs_cardinality.svgOther43.7 KB—
results/gemma4-e2b/vs_jev/compare_accuracy.pngOther118.4 KB124879bb9401
results/gemma4-e2b/vs_jev/compare_accuracy.svgOther29.3 KB—
results/gemma4-e2b/vs_jev/compare_ece.pngOther130.2 KB4fa7d32f0b7e
results/gemma4-e2b/vs_jev/compare_ece.svgOther31.2 KB—
results/gemma4-e4b-it/figures/calibration_map.pngOther180.1 KB4112bd896e65
results/gemma4-e4b-it/figures/calibration_map.svgOther36.8 KB—
results/gemma4-e4b-it/figures/human_vs_model.pngOther410.8 KB1bedacf8e1de
results/gemma4-e4b-it/figures/human_vs_model.svgOther4.2 MB—
results/gemma4-e4b-it/figures/latency.pngOther83.4 KBe74fd97b941b
results/gemma4-e4b-it/figures/latency.svgOther25.9 KB—
results/gemma4-e4b-it/figures/reliability.pngOther510.5 KB2f24d4fa9173
results/gemma4-e4b-it/figures/reliability.svgOther246.8 KB—
results/gemma4-e4b-it/figures/risk_coverage.pngOther274.1 KBc80ff1da56ea
results/gemma4-e4b-it/figures/risk_coverage.svgOther212.8 KB—
results/gemma4-e4b-it/figures/vs_cardinality.pngOther164.7 KBf807f89148c2
results/gemma4-e4b-it/figures/vs_cardinality.svgOther44.7 KB—
results/gemma4-e4b-it/vs_jev/compare_accuracy.pngOther118.4 KB2a8ef0d9266d
results/gemma4-e4b-it/vs_jev/compare_accuracy.svgOther29.3 KB—
results/gemma4-e4b-it/vs_jev/compare_ece.pngOther130.0 KB1c3a9e7a3a9e
results/gemma4-e4b-it/vs_jev/compare_ece.svgOther31.2 KB—
results/jev-1.13.0/figures/calibration_map.pngOther191.7 KB3b1654a69cbb
results/jev-1.13.0/figures/calibration_map.svgOther34.5 KB—
results/jev-1.13.0/figures/human_vs_model.pngOther354.0 KBa23fe6e5e04e
results/jev-1.13.0/figures/human_vs_model.svgOther4.0 MB—
results/jev-1.13.0/figures/latency.pngOther81.7 KB3ee403f31863
results/jev-1.13.0/figures/latency.svgOther25.0 KB—
results/jev-1.13.0/figures/reliability.pngOther377.1 KB36b50982787a
results/jev-1.13.0/figures/reliability.svgOther239.7 KB—
results/jev-1.13.0/figures/risk_coverage.pngOther254.3 KB50909b02e448
results/jev-1.13.0/figures/risk_coverage.svgOther194.2 KB—
results/jev-1.13.0/figures/vs_cardinality.pngOther180.6 KB2d9d4b47dd94
results/jev-1.13.0/figures/vs_cardinality.svgOther45.9 KB—
results/jev-1.13.0/probes/probe_cardinality.pngOther207.0 KB7fa01a07d911
results/jev-1.13.0/probes/probe_cardinality.svgOther54.4 KB—
results/jev-latency-probe/server_time_vs_tokens.pngOther187.3 KBf95b55834c23
results/jev-latency-probe/server_time_vs_tokens.svgOther60.0 KB—
results/k2-horizon-0.9b/figures/calibration_map.pngOther174.4 KB42b41b8b7cb4
results/k2-horizon-0.9b/figures/calibration_map.svgOther35.0 KB—
results/k2-horizon-0.9b/figures/human_vs_model.pngOther362.7 KB536b60bee9a9
results/k2-horizon-0.9b/figures/human_vs_model.svgOther4.2 MB—
results/k2-horizon-0.9b/figures/latency.pngOther86.9 KB2a8c098e2dd2
results/k2-horizon-0.9b/figures/latency.svgOther26.4 KB—
results/k2-horizon-0.9b/figures/reliability.pngOther499.1 KB81393df7aa41
results/k2-horizon-0.9b/figures/reliability.svgOther224.4 KB—
results/k2-horizon-0.9b/figures/risk_coverage.pngOther294.3 KB18f4bbdc8fb1
results/k2-horizon-0.9b/figures/risk_coverage.svgOther228.8 KB—
results/k2-horizon-0.9b/figures/vs_cardinality.pngOther160.6 KB7707b65c30c8
results/k2-horizon-0.9b/figures/vs_cardinality.svgOther43.3 KB—
results/k2-horizon-0.9b/vs_jev/compare_accuracy.pngOther119.7 KB90a23620b9c0
results/k2-horizon-0.9b/vs_jev/compare_accuracy.svgOther29.3 KB—
results/k2-horizon-0.9b/vs_jev/compare_ece.pngOther131.0 KB4d78c207439e
results/k2-horizon-0.9b/vs_jev/compare_ece.svgOther31.2 KB—
results/k2-horizon-7b/figures/calibration_map.pngOther180.5 KB1ebf56880b3d
results/k2-horizon-7b/figures/calibration_map.svgOther36.6 KB—
results/k2-horizon-7b/figures/human_vs_model.pngOther407.5 KBf2154f906e40
results/k2-horizon-7b/figures/human_vs_model.svgOther4.2 MB—
results/k2-horizon-7b/figures/latency.pngOther83.1 KB2f629e0d39ce
results/k2-horizon-7b/figures/latency.svgOther25.8 KB—
results/k2-horizon-7b/figures/reliability.pngOther516.0 KB679ca191c4fd
results/k2-horizon-7b/figures/reliability.svgOther254.6 KB—
results/k2-horizon-7b/figures/risk_coverage.pngOther270.4 KB70f9b5966735
results/k2-horizon-7b/figures/risk_coverage.svgOther208.9 KB—
results/k2-horizon-7b/figures/vs_cardinality.pngOther163.6 KBacdc762a4cda
results/k2-horizon-7b/figures/vs_cardinality.svgOther44.7 KB—
results/k2-horizon-7b/vs_jev/compare_accuracy.pngOther118.7 KBa9f3b3b21512
results/k2-horizon-7b/vs_jev/compare_accuracy.svgOther29.3 KB—
results/k2-horizon-7b/vs_jev/compare_ece.pngOther129.6 KB7e0c0c066461
results/k2-horizon-7b/vs_jev/compare_ece.svgOther31.2 KB—
results/latency/latency_before_after.pngOther240.2 KBb6d398be33b1
results/latency/latency_before_after.svgOther33.4 KB—
results/latency/latency_generate.pngOther176.9 KB7a6304c2f005
results/latency/latency_generate.svgOther20.4 KB—
results/latency/latency_ladder.pngOther236.2 KB270d387d1dff
results/latency/latency_ladder.svgOther49.4 KB—
results/leaderboard/heatmap_accuracy.pngOther979.0 KB62e97946e140
results/leaderboard/heatmap_accuracy.svgOther181.3 KB—
results/leaderboard/heatmap_ece.pngOther863.3 KB3ab56d16927d
results/leaderboard/heatmap_ece.svgOther182.0 KB—
results/leaderboard/models_map.pngOther254.7 KB99ae6e922f5b
results/leaderboard/models_map.svgOther28.7 KB—
results/pplx-decider-v1-27b/figures/calibration_map.pngOther177.6 KBde478c6dbe12
results/pplx-decider-v1-27b/figures/calibration_map.svgOther35.2 KB—
results/pplx-decider-v1-27b/figures/human_vs_model.pngOther408.0 KB1c3b4d62103a
results/pplx-decider-v1-27b/figures/human_vs_model.svgOther4.2 MB—
results/pplx-decider-v1-27b/figures/latency.pngOther84.8 KBe4a27d224136
results/pplx-decider-v1-27b/figures/latency.svgOther25.3 KB—
results/pplx-decider-v1-27b/figures/reliability.pngOther517.8 KB5c34fbd2c20b
results/pplx-decider-v1-27b/figures/reliability.svgOther251.4 KB—
results/pplx-decider-v1-27b/figures/risk_coverage.pngOther246.2 KBb501f9654760
results/pplx-decider-v1-27b/figures/risk_coverage.svgOther173.1 KB—
results/pplx-decider-v1-27b/figures/vs_cardinality.pngOther172.7 KBc6fa68aba647
results/pplx-decider-v1-27b/figures/vs_cardinality.svgOther46.8 KB—
results/qwen35-0.8b-base/figures/calibration_map.pngOther181.0 KB9e42a05c0268
results/qwen35-0.8b-base/figures/calibration_map.svgOther37.0 KB—
results/qwen35-0.8b-base/figures/human_vs_model.pngOther381.2 KB3be07c587277
results/qwen35-0.8b-base/figures/human_vs_model.svgOther4.2 MB—
results/qwen35-0.8b-base/figures/latency.pngOther84.7 KBe79efb8bb861
results/qwen35-0.8b-base/figures/latency.svgOther24.4 KB—
results/qwen35-0.8b-base/figures/reliability.pngOther487.9 KB966d721b8a58
results/qwen35-0.8b-base/figures/reliability.svgOther207.6 KB—
results/qwen35-0.8b-base/figures/risk_coverage.pngOther289.6 KBfbdde3f68822
results/qwen35-0.8b-base/figures/risk_coverage.svgOther229.9 KB—
results/qwen35-0.8b-base/figures/vs_cardinality.pngOther169.0 KB61d263349f6b
results/qwen35-0.8b-base/figures/vs_cardinality.svgOther44.7 KB—
results/qwen35-0.8b-base/vs_jev/compare_accuracy.pngOther121.7 KBda21c9172bd2
results/qwen35-0.8b-base/vs_jev/compare_accuracy.svgOther29.3 KB—
results/qwen35-0.8b-base/vs_jev/compare_ece.pngOther133.3 KB7c31eef8a807
results/qwen35-0.8b-base/vs_jev/compare_ece.svgOther31.2 KB—
results/qwen35-0.8b/figures/calibration_map.pngOther179.8 KBb9f16f7fd371
results/qwen35-0.8b/figures/calibration_map.svgOther37.0 KB—
results/qwen35-0.8b/figures/human_vs_model.pngOther392.6 KB7f28f5756d61
results/qwen35-0.8b/figures/human_vs_model.svgOther4.2 MB—
results/qwen35-0.8b/figures/latency.pngOther82.5 KB06618744aaa7
results/qwen35-0.8b/figures/latency.svgOther24.9 KB—
results/qwen35-0.8b/figures/reliability.pngOther503.9 KB13e3d957de36
results/qwen35-0.8b/figures/reliability.svgOther236.2 KB—
results/qwen35-0.8b/figures/risk_coverage.pngOther282.9 KBa8ef9553c9a6
results/qwen35-0.8b/figures/risk_coverage.svgOther230.3 KB—
results/qwen35-0.8b/figures/vs_cardinality.pngOther168.5 KB0a34673571a7
results/qwen35-0.8b/figures/vs_cardinality.svgOther45.2 KB—
results/qwen35-0.8b/vs_jev/compare_accuracy.pngOther120.3 KB3588109e179b
results/qwen35-0.8b/vs_jev/compare_accuracy.svgOther29.3 KB—
results/qwen35-0.8b/vs_jev/compare_ece.pngOther131.3 KB49cf72c32513
results/qwen35-0.8b/vs_jev/compare_ece.svgOther31.2 KB—
results/qwen35-2b-t1/figures/calibration_map.pngOther165.8 KB0a1c66791915
results/qwen35-2b-t1/figures/calibration_map.svgOther32.3 KB—
results/qwen35-2b-t1/figures/human_vs_model.pngOther394.9 KB914b275af26a
results/qwen35-2b-t1/figures/human_vs_model.svgOther4.2 MB—
results/qwen35-2b-t1/figures/reliability.pngOther504.9 KB8804b2a9d1bb
results/qwen35-2b-t1/figures/reliability.svgOther242.1 KB—
results/qwen35-2b-t1/figures/risk_coverage.pngOther252.1 KB67e3e26dd0d9
results/qwen35-2b-t1/figures/risk_coverage.svgOther218.5 KB—
results/qwen35-2b-t1/figures/vs_cardinality.pngOther157.3 KB7f47d1456120
results/qwen35-2b-t1/figures/vs_cardinality.svgOther42.7 KB—
results/qwen35-2b-t1r-e6-s0/figures/calibration_map.pngOther178.7 KB71752124a721
results/qwen35-2b-t1r-e6-s0/figures/calibration_map.svgOther35.8 KB—
results/qwen35-2b-t1r-e6-s0/figures/human_vs_model.pngOther412.3 KB7f428ee3a788
results/qwen35-2b-t1r-e6-s0/figures/human_vs_model.svgOther4.2 MB—
results/qwen35-2b-t1r-e6-s0/figures/reliability.pngOther512.7 KBd325a7ddda8d
results/qwen35-2b-t1r-e6-s0/figures/reliability.svgOther254.1 KB—
results/qwen35-2b-t1r-e6-s0/figures/risk_coverage.pngOther278.2 KB97c5c63aa237
results/qwen35-2b-t1r-e6-s0/figures/risk_coverage.svgOther223.2 KB—
results/qwen35-2b-t1r-e6-s0/figures/vs_cardinality.pngOther162.4 KBeaaad9b6a7d4
results/qwen35-2b-t1r-e6-s0/figures/vs_cardinality.svgOther43.2 KB—
results/qwen35-2b-t1r-e6-s1/figures/calibration_map.pngOther178.2 KB505ef6c049a5
results/qwen35-2b-t1r-e6-s1/figures/calibration_map.svgOther35.8 KB—
results/qwen35-2b-t1r-e6-s1/figures/human_vs_model.pngOther412.8 KB940bbc32751c
results/qwen35-2b-t1r-e6-s1/figures/human_vs_model.svgOther4.2 MB—
results/qwen35-2b-t1r-e6-s1/figures/reliability.pngOther519.3 KB4f47bf5b7a85
results/qwen35-2b-t1r-e6-s1/figures/reliability.svgOther254.9 KB—
results/qwen35-2b-t1r-e6-s1/figures/risk_coverage.pngOther267.4 KBbc070b5912f2
results/qwen35-2b-t1r-e6-s1/figures/risk_coverage.svgOther222.1 KB—
results/qwen35-2b-t1r-e6-s1/figures/vs_cardinality.pngOther162.5 KBee701586db71
results/qwen35-2b-t1r-e6-s1/figures/vs_cardinality.svgOther43.2 KB—
results/qwen35-2b-t1r-e6-s2/figures/calibration_map.pngOther176.9 KBc3cdb50c4339
results/qwen35-2b-t1r-e6-s2/figures/calibration_map.svgOther35.8 KB—
results/qwen35-2b-t1r-e6-s2/figures/human_vs_model.pngOther412.4 KB7b31dc9b9664
results/qwen35-2b-t1r-e6-s2/figures/human_vs_model.svgOther4.2 MB—
results/qwen35-2b-t1r-e6-s2/figures/reliability.pngOther515.0 KB0e94d3c60819
results/qwen35-2b-t1r-e6-s2/figures/reliability.svgOther254.2 KB—
results/qwen35-2b-t1r-e6-s2/figures/risk_coverage.pngOther277.5 KBc3c3b44fddee
results/qwen35-2b-t1r-e6-s2/figures/risk_coverage.svgOther222.7 KB—
results/qwen35-2b-t1r-e6-s2/figures/vs_cardinality.pngOther162.8 KBfa236c71ab4c
results/qwen35-2b-t1r-e6-s2/figures/vs_cardinality.svgOther43.7 KB—
results/qwen35-2b-t1r-e6-s3/figures/calibration_map.pngOther177.9 KB52e669e6b12d
results/qwen35-2b-t1r-e6-s3/figures/calibration_map.svgOther35.8 KB—
results/qwen35-2b-t1r-e6-s3/figures/human_vs_model.pngOther413.2 KB1c26e77607df
results/qwen35-2b-t1r-e6-s3/figures/human_vs_model.svgOther4.2 MB—
results/qwen35-2b-t1r-e6-s3/figures/reliability.pngOther514.7 KB1f309922c5c2
results/qwen35-2b-t1r-e6-s3/figures/reliability.svgOther254.2 KB—
results/qwen35-2b-t1r-e6-s3/figures/risk_coverage.pngOther276.9 KBa9ff1a002e64
results/qwen35-2b-t1r-e6-s3/figures/risk_coverage.svgOther224.8 KB—
results/qwen35-2b-t1r-e6-s3/figures/vs_cardinality.pngOther161.3 KBbce4677b431a
results/qwen35-2b-t1r-e6-s3/figures/vs_cardinality.svgOther43.2 KB—
results/qwen35-2b-t1r-e6-s4/figures/calibration_map.pngOther177.1 KB3db7948232f3
results/qwen35-2b-t1r-e6-s4/figures/calibration_map.svgOther35.8 KB—
results/qwen35-2b-t1r-e6-s4/figures/human_vs_model.pngOther412.5 KB87b59e9fa6c1
results/qwen35-2b-t1r-e6-s4/figures/human_vs_model.svgOther4.2 MB—
results/qwen35-2b-t1r-e6-s4/figures/reliability.pngOther511.9 KB079656242e7d
results/qwen35-2b-t1r-e6-s4/figures/reliability.svgOther254.7 KB—
results/qwen35-2b-t1r-e6-s4/figures/risk_coverage.pngOther278.5 KB2ed1fbd10331
results/qwen35-2b-t1r-e6-s4/figures/risk_coverage.svgOther225.0 KB—
results/qwen35-2b-t1r-e6-s4/figures/vs_cardinality.pngOther162.3 KB0317a81c74d5
results/qwen35-2b-t1r-e6-s4/figures/vs_cardinality.svgOther43.2 KB—
results/qwen35-2b-t1r-s0/figures/calibration_map.pngOther181.0 KB1160ef4c6eda
results/qwen35-2b-t1r-s0/figures/calibration_map.svgOther36.0 KB—
results/qwen35-2b-t1r-s0/figures/human_vs_model.pngOther410.6 KB2721fb94d478
results/qwen35-2b-t1r-s0/figures/human_vs_model.svgOther4.2 MB—
results/qwen35-2b-t1r-s0/figures/reliability.pngOther519.1 KB8cfe058d66ab
results/qwen35-2b-t1r-s0/figures/reliability.svgOther254.7 KB—
results/qwen35-2b-t1r-s0/figures/risk_coverage.pngOther286.1 KBee716bd4366a
results/qwen35-2b-t1r-s0/figures/risk_coverage.svgOther221.9 KB—
results/qwen35-2b-t1r-s0/figures/vs_cardinality.pngOther169.7 KB19c7233b0d30
results/qwen35-2b-t1r-s0/figures/vs_cardinality.svgOther45.2 KB—
results/qwen35-2b-t1r-s1/figures/calibration_map.pngOther179.3 KBb10e7e73dec0
results/qwen35-2b-t1r-s1/figures/calibration_map.svgOther36.1 KB—
results/qwen35-2b-t1r-s1/figures/human_vs_model.pngOther405.1 KB5d1545467061
results/qwen35-2b-t1r-s1/figures/human_vs_model.svgOther4.2 MB—
results/qwen35-2b-t1r-s1/figures/reliability.pngOther517.2 KBf70b091ea331
results/qwen35-2b-t1r-s1/figures/reliability.svgOther254.1 KB—
results/qwen35-2b-t1r-s1/figures/risk_coverage.pngOther286.0 KBad4ce9fa4a4b
results/qwen35-2b-t1r-s1/figures/risk_coverage.svgOther220.8 KB—
results/qwen35-2b-t1r-s1/figures/vs_cardinality.pngOther169.4 KB69319973a537
results/qwen35-2b-t1r-s1/figures/vs_cardinality.svgOther45.7 KB—
results/qwen35-2b-t1r-s2/figures/calibration_map.pngOther180.4 KBdd4c9c4ffdef
results/qwen35-2b-t1r-s2/figures/calibration_map.svgOther35.9 KB—
results/qwen35-2b-t1r-s2/figures/human_vs_model.pngOther403.8 KB009678b36606
results/qwen35-2b-t1r-s2/figures/human_vs_model.svgOther4.2 MB—
results/qwen35-2b-t1r-s2/figures/reliability.pngOther516.4 KBc50aca30dd0d
results/qwen35-2b-t1r-s2/figures/reliability.svgOther246.5 KB—
results/qwen35-2b-t1r-s2/figures/risk_coverage.pngOther278.1 KB68977964130d
results/qwen35-2b-t1r-s2/figures/risk_coverage.svgOther223.4 KB—
results/qwen35-2b-t1r-s2/figures/vs_cardinality.pngOther170.4 KB45f6ef38ffaa
results/qwen35-2b-t1r-s2/figures/vs_cardinality.svgOther46.3 KB—
results/qwen35-2b-t1r-s3/figures/calibration_map.pngOther177.2 KBde0115affa58
results/qwen35-2b-t1r-s3/figures/calibration_map.svgOther35.1 KB—
results/qwen35-2b-t1r-s3/figures/human_vs_model.pngOther402.1 KB714e92519061
results/qwen35-2b-t1r-s3/figures/human_vs_model.svgOther4.2 MB—
results/qwen35-2b-t1r-s3/figures/reliability.pngOther521.3 KB23089ab01798
results/qwen35-2b-t1r-s3/figures/reliability.svgOther248.4 KB—
results/qwen35-2b-t1r-s3/figures/risk_coverage.pngOther274.3 KB501697f86294
results/qwen35-2b-t1r-s3/figures/risk_coverage.svgOther221.0 KB—
results/qwen35-2b-t1r-s3/figures/vs_cardinality.pngOther165.4 KBb396b7c1e651
results/qwen35-2b-t1r-s3/figures/vs_cardinality.svgOther45.3 KB—
results/qwen35-2b-t1r-s4/figures/calibration_map.pngOther180.9 KB13aa5dba2be1
results/qwen35-2b-t1r-s4/figures/calibration_map.svgOther36.1 KB—
results/qwen35-2b-t1r-s4/figures/human_vs_model.pngOther401.3 KBe796adf8e4df
results/qwen35-2b-t1r-s4/figures/human_vs_model.svgOther4.2 MB—
results/qwen35-2b-t1r-s4/figures/reliability.pngOther518.2 KBbbb2fce39bb6
results/qwen35-2b-t1r-s4/figures/reliability.svgOther249.2 KB—
results/qwen35-2b-t1r-s4/figures/risk_coverage.pngOther282.1 KB2e0e81d1a30e
results/qwen35-2b-t1r-s4/figures/risk_coverage.svgOther224.1 KB—
results/qwen35-2b-t1r-s4/figures/vs_cardinality.pngOther166.4 KB9311aec6fad6
results/qwen35-2b-t1r-s4/figures/vs_cardinality.svgOther44.2 KB—
results/qwen35-2b-t1r/figures/calibration_map.pngOther178.5 KB04c68f7e31e4
results/qwen35-2b-t1r/figures/calibration_map.svgOther36.0 KB—
results/qwen35-2b-t1r/figures/human_vs_model.pngOther404.8 KB81ce5a8e052e
results/qwen35-2b-t1r/figures/human_vs_model.svgOther4.2 MB—
results/qwen35-2b-t1r/figures/reliability.pngOther518.2 KB35408a2bf04b
results/qwen35-2b-t1r/figures/reliability.svgOther254.8 KB—
results/qwen35-2b-t1r/figures/risk_coverage.pngOther272.7 KBe4b09413a4b0
results/qwen35-2b-t1r/figures/risk_coverage.svgOther221.3 KB—
results/qwen35-2b-t1r/figures/vs_cardinality.pngOther168.4 KBb581a6e9479d
results/qwen35-2b-t1r/figures/vs_cardinality.svgOther45.3 KB—
results/qwen35-2b-t2-lowlr-s1/figures/calibration_map.pngOther179.6 KB5bc3d6dd7ece
results/qwen35-2b-t2-lowlr-s1/figures/calibration_map.svgOther36.0 KB—
results/qwen35-2b-t2-lowlr-s1/figures/human_vs_model.pngOther378.0 KBbb23618a91b4
results/qwen35-2b-t2-lowlr-s1/figures/human_vs_model.svgOther4.2 MB—
results/qwen35-2b-t2-lowlr-s1/figures/reliability.pngOther519.7 KBbb7d84ad15a1
results/qwen35-2b-t2-lowlr-s1/figures/reliability.svgOther241.5 KB—
results/qwen35-2b-t2-lowlr-s1/figures/risk_coverage.pngOther293.6 KB9b8e5759292e
results/qwen35-2b-t2-lowlr-s1/figures/risk_coverage.svgOther212.1 KB—
results/qwen35-2b-t2-lowlr-s1/figures/vs_cardinality.pngOther165.2 KBf5d3993799fc
results/qwen35-2b-t2-lowlr-s1/figures/vs_cardinality.svgOther44.8 KB—
results/qwen35-2b-t2-lowlr-s2/figures/calibration_map.pngOther177.1 KBb85c6e0722db
results/qwen35-2b-t2-lowlr-s2/figures/calibration_map.svgOther35.6 KB—
results/qwen35-2b-t2-lowlr-s2/figures/human_vs_model.pngOther411.2 KB0f3e40c78614
results/qwen35-2b-t2-lowlr-s2/figures/human_vs_model.svgOther4.2 MB—
results/qwen35-2b-t2-lowlr-s2/figures/reliability.pngOther515.5 KB58046fdb00a4
results/qwen35-2b-t2-lowlr-s2/figures/reliability.svgOther245.6 KB—
results/qwen35-2b-t2-lowlr-s2/figures/risk_coverage.pngOther279.9 KB35a290bee918
results/qwen35-2b-t2-lowlr-s2/figures/risk_coverage.svgOther211.0 KB—
results/qwen35-2b-t2-lowlr-s2/figures/vs_cardinality.pngOther168.9 KB304aa229bc0e
results/qwen35-2b-t2-lowlr-s2/figures/vs_cardinality.svgOther45.7 KB—
results/qwen35-2b-t2-lowlr-soft/figures/calibration_map.pngOther179.9 KB23a2f36351a2
results/qwen35-2b-t2-lowlr-soft/figures/calibration_map.svgOther36.0 KB—
results/qwen35-2b-t2-lowlr-soft/figures/human_vs_model.pngOther384.6 KB0dc7fbb00976
results/qwen35-2b-t2-lowlr-soft/figures/human_vs_model.svgOther4.2 MB—
results/qwen35-2b-t2-lowlr-soft/figures/reliability.pngOther509.9 KBa034fd470148
results/qwen35-2b-t2-lowlr-soft/figures/reliability.svgOther241.5 KB—
results/qwen35-2b-t2-lowlr-soft/figures/risk_coverage.pngOther284.7 KB87745e2c0cb4
results/qwen35-2b-t2-lowlr-soft/figures/risk_coverage.svgOther211.3 KB—
results/qwen35-2b-t2-lowlr-soft/figures/vs_cardinality.pngOther167.4 KBf2dea1d3f63e
results/qwen35-2b-t2-lowlr-soft/figures/vs_cardinality.svgOther45.3 KB—
results/qwen35-2b-t2-lowlr/figures/calibration_map.pngOther180.5 KB3ddc7aaf403e
results/qwen35-2b-t2-lowlr/figures/calibration_map.svgOther35.8 KB—
results/qwen35-2b-t2-lowlr/figures/human_vs_model.pngOther393.8 KBccfb6cc2b5bf
results/qwen35-2b-t2-lowlr/figures/human_vs_model.svgOther4.2 MB—
results/qwen35-2b-t2-lowlr/figures/reliability.pngOther517.2 KB6ab4a0ef8b36
results/qwen35-2b-t2-lowlr/figures/reliability.svgOther242.9 KB—
results/qwen35-2b-t2-lowlr/figures/risk_coverage.pngOther288.8 KBf26dacb75c22
results/qwen35-2b-t2-lowlr/figures/risk_coverage.svgOther216.3 KB—
results/qwen35-2b-t2-lowlr/figures/vs_cardinality.pngOther169.5 KBb05ceb78987d
results/qwen35-2b-t2-lowlr/figures/vs_cardinality.svgOther45.2 KB—
results/qwen35-2b-t2-s1/figures/calibration_map.pngOther179.0 KB28b004ef7c3c
results/qwen35-2b-t2-s1/figures/calibration_map.svgOther36.0 KB—
results/qwen35-2b-t2-s1/figures/human_vs_model.pngOther377.6 KBd46da2be5ab1
results/qwen35-2b-t2-s1/figures/human_vs_model.svgOther4.2 MB—
results/qwen35-2b-t2-s1/figures/reliability.pngOther515.1 KBdbfe8bafe7a4
results/qwen35-2b-t2-s1/figures/reliability.svgOther236.7 KB—
results/qwen35-2b-t2-s1/figures/risk_coverage.pngOther263.4 KB709085ec015c
results/qwen35-2b-t2-s1/figures/risk_coverage.svgOther204.5 KB—
results/qwen35-2b-t2-s1/figures/vs_cardinality.pngOther166.9 KB055439a74f25
results/qwen35-2b-t2-s1/figures/vs_cardinality.svgOther45.3 KB—
results/qwen35-2b-t2-s2/figures/calibration_map.pngOther178.3 KB47a9af60b961
results/qwen35-2b-t2-s2/figures/calibration_map.svgOther35.8 KB—
results/qwen35-2b-t2-s2/figures/human_vs_model.pngOther407.6 KBb0a53e3996a5
results/qwen35-2b-t2-s2/figures/human_vs_model.svgOther4.2 MB—
results/qwen35-2b-t2-s2/figures/reliability.pngOther511.8 KB2363eb76f8a9
results/qwen35-2b-t2-s2/figures/reliability.svgOther242.1 KB—
results/qwen35-2b-t2-s2/figures/risk_coverage.pngOther263.0 KB66fbe4344120
results/qwen35-2b-t2-s2/figures/risk_coverage.svgOther211.3 KB—
results/qwen35-2b-t2-s2/figures/vs_cardinality.pngOther162.1 KB6172878583fa
results/qwen35-2b-t2-s2/figures/vs_cardinality.svgOther43.2 KB—
results/qwen35-2b-t2-soft/figures/calibration_map.pngOther183.1 KB96f2b1cf37ab
results/qwen35-2b-t2-soft/figures/calibration_map.svgOther36.1 KB—
results/qwen35-2b-t2-soft/figures/human_vs_model.pngOther379.6 KBe240bfa343cc
results/qwen35-2b-t2-soft/figures/human_vs_model.svgOther4.2 MB—
results/qwen35-2b-t2-soft/figures/reliability.pngOther511.2 KB57f1f44e52ad
results/qwen35-2b-t2-soft/figures/reliability.svgOther241.5 KB—
results/qwen35-2b-t2-soft/figures/risk_coverage.pngOther288.1 KB29a664a5e6bc
results/qwen35-2b-t2-soft/figures/risk_coverage.svgOther211.5 KB—
results/qwen35-2b-t2-soft/figures/vs_cardinality.pngOther165.6 KB28db5c758916
results/qwen35-2b-t2-soft/figures/vs_cardinality.svgOther43.7 KB—
results/qwen35-2b-t2/figures/calibration_map.pngOther178.5 KBc8027cb4d05f
results/qwen35-2b-t2/figures/calibration_map.svgOther35.7 KB—
results/qwen35-2b-t2/figures/human_vs_model.pngOther365.3 KB767e4bf698aa
results/qwen35-2b-t2/figures/human_vs_model.svgOther4.2 MB—
results/qwen35-2b-t2/figures/reliability.pngOther520.7 KB2c5458c1fc3c
results/qwen35-2b-t2/figures/reliability.svgOther245.7 KB—
results/qwen35-2b-t2/figures/risk_coverage.pngOther267.2 KB05063f6b330b
results/qwen35-2b-t2/figures/risk_coverage.svgOther211.1 KB—
results/qwen35-2b-t2/figures/vs_cardinality.pngOther164.0 KB1a0cfe002070
results/qwen35-2b-t2/figures/vs_cardinality.svgOther44.3 KB—
results/qwen35-2b/figures/calibration_map.pngOther180.8 KBacbde6e91a03
results/qwen35-2b/figures/calibration_map.svgOther36.3 KB—
results/qwen35-2b/figures/human_vs_model.pngOther406.8 KB1dd0b8b5f58a
results/qwen35-2b/figures/human_vs_model.svgOther4.2 MB—
results/qwen35-2b/figures/latency.pngOther84.2 KB271f6452538f
results/qwen35-2b/figures/latency.svgOther26.3 KB—
results/qwen35-2b/figures/reliability.pngOther512.8 KB6b76d6aafc84
results/qwen35-2b/figures/reliability.svgOther250.2 KB—
results/qwen35-2b/figures/risk_coverage.pngOther281.5 KBe7975caca75b
results/qwen35-2b/figures/risk_coverage.svgOther225.2 KB—
results/qwen35-2b/figures/vs_cardinality.pngOther171.4 KB00a1bb0dece2
results/qwen35-2b/figures/vs_cardinality.svgOther46.3 KB—
results/qwen35-2b/vs_jev/compare_accuracy.pngOther119.3 KB43d1bb79d4ca
results/qwen35-2b/vs_jev/compare_accuracy.svgOther29.3 KB—
results/qwen35-2b/vs_jev/compare_ece.pngOther130.2 KB7171bdf8d6c2
results/qwen35-2b/vs_jev/compare_ece.svgOther31.2 KB—
results/qwen35-4b-t1r-s1/figures/calibration_map.pngOther178.5 KB372b0b980b05
results/qwen35-4b-t1r-s1/figures/calibration_map.svgOther35.8 KB—
results/qwen35-4b-t1r-s1/figures/human_vs_model.pngOther412.5 KBed2281ca0ef9
results/qwen35-4b-t1r-s1/figures/human_vs_model.svgOther4.2 MB—
results/qwen35-4b-t1r-s1/figures/reliability.pngOther516.2 KB9543d60ff0aa
results/qwen35-4b-t1r-s1/figures/reliability.svgOther255.4 KB—
results/qwen35-4b-t1r-s1/figures/risk_coverage.pngOther284.8 KB1e7c2d773002
results/qwen35-4b-t1r-s1/figures/risk_coverage.svgOther209.4 KB—
results/qwen35-4b-t1r-s1/figures/vs_cardinality.pngOther168.2 KB932cc32e5ea1
results/qwen35-4b-t1r-s1/figures/vs_cardinality.svgOther45.2 KB—
results/qwen35-4b-t1r-s2/figures/calibration_map.pngOther178.3 KBda79c60811dd
results/qwen35-4b-t1r-s2/figures/calibration_map.svgOther35.6 KB—
results/qwen35-4b-t1r-s2/figures/human_vs_model.pngOther416.1 KB7d23c2d2b61f
results/qwen35-4b-t1r-s2/figures/human_vs_model.svgOther4.2 MB—
results/qwen35-4b-t1r-s2/figures/reliability.pngOther515.7 KBa5f72d212fbe
results/qwen35-4b-t1r-s2/figures/reliability.svgOther252.6 KB—
results/qwen35-4b-t1r-s2/figures/risk_coverage.pngOther270.3 KB23e7c2db3398
results/qwen35-4b-t1r-s2/figures/risk_coverage.svgOther201.4 KB—
results/qwen35-4b-t1r-s2/figures/vs_cardinality.pngOther163.6 KB1a4b57bce82a
results/qwen35-4b-t1r-s2/figures/vs_cardinality.svgOther43.7 KB—
results/qwen35-4b-t1r-s3/figures/calibration_map.pngOther176.9 KB9c673c75b738
results/qwen35-4b-t1r-s3/figures/calibration_map.svgOther35.4 KB—
results/qwen35-4b-t1r-s3/figures/human_vs_model.pngOther415.7 KBc42a35703e08
results/qwen35-4b-t1r-s3/figures/human_vs_model.svgOther4.2 MB—
results/qwen35-4b-t1r-s3/figures/reliability.pngOther517.5 KB3fcb25e47ff3
results/qwen35-4b-t1r-s3/figures/reliability.svgOther252.1 KB—
results/qwen35-4b-t1r-s3/figures/risk_coverage.pngOther272.6 KB906fb106ce61
results/qwen35-4b-t1r-s3/figures/risk_coverage.svgOther205.3 KB—
results/qwen35-4b-t1r-s3/figures/vs_cardinality.pngOther162.8 KB932dc35f367f
results/qwen35-4b-t1r-s3/figures/vs_cardinality.svgOther43.7 KB—
results/qwen35-4b-t1r-s4/figures/calibration_map.pngOther177.6 KBca9d9921a807
results/qwen35-4b-t1r-s4/figures/calibration_map.svgOther35.6 KB—
results/qwen35-4b-t1r-s4/figures/human_vs_model.pngOther418.6 KBd9ebee33f3e2
results/qwen35-4b-t1r-s4/figures/human_vs_model.svgOther4.2 MB—
results/qwen35-4b-t1r-s4/figures/reliability.pngOther514.7 KB3342ce79eb10
results/qwen35-4b-t1r-s4/figures/reliability.svgOther254.0 KB—
results/qwen35-4b-t1r-s4/figures/risk_coverage.pngOther273.6 KBf797d8499e05
results/qwen35-4b-t1r-s4/figures/risk_coverage.svgOther206.4 KB—
results/qwen35-4b-t1r-s4/figures/vs_cardinality.pngOther163.5 KBf554180b2f30
results/qwen35-4b-t1r-s4/figures/vs_cardinality.svgOther43.7 KB—
results/qwen35-4b-t1r/figures/calibration_map.pngOther179.3 KB682e9fda7ce2
results/qwen35-4b-t1r/figures/calibration_map.svgOther35.6 KB—
results/qwen35-4b-t1r/figures/human_vs_model.pngOther419.6 KB0002b527525a
results/qwen35-4b-t1r/figures/human_vs_model.svgOther4.2 MB—
results/qwen35-4b-t1r/figures/reliability.pngOther520.9 KB51062ed58697
results/qwen35-4b-t1r/figures/reliability.svgOther260.5 KB—
results/qwen35-4b-t1r/figures/risk_coverage.pngOther273.6 KBf91e553f5e2f
results/qwen35-4b-t1r/figures/risk_coverage.svgOther202.7 KB—
results/qwen35-4b-t1r/figures/vs_cardinality.pngOther170.8 KBfc2339575af2
results/qwen35-4b-t1r/figures/vs_cardinality.svgOther45.7 KB—
results/qwen35-4b-t2-lowlr/figures/calibration_map.pngOther177.5 KB9792c19dce48
results/qwen35-4b-t2-lowlr/figures/calibration_map.svgOther35.2 KB—
results/qwen35-4b-t2-lowlr/figures/human_vs_model.pngOther391.6 KB6cff535c6ac0
results/qwen35-4b-t2-lowlr/figures/human_vs_model.svgOther4.2 MB—
results/qwen35-4b-t2-lowlr/figures/reliability.pngOther513.6 KB27382dd561bd
results/qwen35-4b-t2-lowlr/figures/reliability.svgOther241.6 KB—
results/qwen35-4b-t2-lowlr/figures/risk_coverage.pngOther280.1 KB46619706741b
results/qwen35-4b-t2-lowlr/figures/risk_coverage.svgOther193.6 KB—
results/qwen35-4b-t2-lowlr/figures/vs_cardinality.pngOther164.4 KB57d3084aabb0
results/qwen35-4b-t2-lowlr/figures/vs_cardinality.svgOther44.2 KB—
results/qwen35-4b-t2/figures/calibration_map.pngOther176.7 KB9f3ed56dda88
results/qwen35-4b-t2/figures/calibration_map.svgOther35.8 KB—
results/qwen35-4b-t2/figures/human_vs_model.pngOther364.2 KB8b8a2ab3a22d
results/qwen35-4b-t2/figures/human_vs_model.svgOther4.2 MB—
results/qwen35-4b-t2/figures/reliability.pngOther510.3 KBd606862ac07e
results/qwen35-4b-t2/figures/reliability.svgOther221.9 KB—
results/qwen35-4b-t2/figures/risk_coverage.pngOther279.5 KB46d4e3fd6fb0
results/qwen35-4b-t2/figures/risk_coverage.svgOther186.0 KB—
results/qwen35-4b-t2/figures/vs_cardinality.pngOther165.2 KBb635ba95a27c
results/qwen35-4b-t2/figures/vs_cardinality.svgOther44.8 KB—
results/qwen35-4b-tev1fmt/figures/calibration_map.pngOther186.0 KB450e0b13d44f
results/qwen35-4b-tev1fmt/figures/calibration_map.svgOther36.7 KB—
results/qwen35-4b-tev1fmt/figures/human_vs_model.pngOther425.2 KB2cac19e7aed6
results/qwen35-4b-tev1fmt/figures/human_vs_model.svgOther4.2 MB—
results/qwen35-4b-tev1fmt/figures/latency.pngOther87.3 KBf94775fe8ff6
results/qwen35-4b-tev1fmt/figures/latency.svgOther24.9 KB—
results/qwen35-4b-tev1fmt/figures/reliability.pngOther521.5 KB9ffcb9c017a6
results/qwen35-4b-tev1fmt/figures/reliability.svgOther256.6 KB—
results/qwen35-4b-tev1fmt/figures/risk_coverage.pngOther274.2 KBbbaad8b5d937
results/qwen35-4b-tev1fmt/figures/risk_coverage.svgOther207.5 KB—
results/qwen35-4b-tev1fmt/figures/vs_cardinality.pngOther171.7 KBaea3a5038e47
results/qwen35-4b-tev1fmt/figures/vs_cardinality.svgOther45.2 KB—
results/qwen35-4b-tev1fmt/vs_jev/compare_accuracy.pngOther126.0 KB4b0378ec58cd
results/qwen35-4b-tev1fmt/vs_jev/compare_accuracy.svgOther29.4 KB—
results/qwen35-4b-tev1fmt/vs_jev/compare_ece.pngOther135.9 KB9d1673c15f1c
results/qwen35-4b-tev1fmt/vs_jev/compare_ece.svgOther31.2 KB—
results/qwen35-4b/figures/calibration_map.pngOther179.8 KB87d6bd3f29a7
results/qwen35-4b/figures/calibration_map.svgOther36.1 KB—
results/qwen35-4b/figures/human_vs_model.pngOther418.3 KBc0c83dc929f9
results/qwen35-4b/figures/human_vs_model.svgOther4.2 MB—
results/qwen35-4b/figures/latency.pngOther86.1 KBba84b1d4538e
results/qwen35-4b/figures/latency.svgOther26.4 KB—
results/qwen35-4b/figures/reliability.pngOther514.4 KB118a6848c125
results/qwen35-4b/figures/reliability.svgOther256.6 KB—
results/qwen35-4b/figures/risk_coverage.pngOther267.9 KBffd18348199a
results/qwen35-4b/figures/risk_coverage.svgOther201.2 KB—
results/qwen35-4b/figures/vs_cardinality.pngOther171.4 KBb9d49d9d6765
results/qwen35-4b/figures/vs_cardinality.svgOther46.2 KB—
results/qwen35-4b/vs_jev/compare_accuracy.pngOther119.2 KBcb1442145f28
results/qwen35-4b/vs_jev/compare_accuracy.svgOther29.3 KB—
results/qwen35-4b/vs_jev/compare_ece.pngOther129.8 KB48c01ad26e3a
results/qwen35-4b/vs_jev/compare_ece.svgOther31.2 KB—
results/qwen35-9b-t1r-s0/figures/calibration_map.pngOther178.4 KB6a07d692bc05
results/qwen35-9b-t1r-s0/figures/calibration_map.svgOther35.4 KB—
results/qwen35-9b-t1r-s0/figures/human_vs_model.pngOther408.2 KBb8b7d144df30
results/qwen35-9b-t1r-s0/figures/human_vs_model.svgOther4.2 MB—
results/qwen35-9b-t1r-s0/figures/reliability.pngOther517.5 KB641f17f98e10
results/qwen35-9b-t1r-s0/figures/reliability.svgOther249.1 KB—
results/qwen35-9b-t1r-s0/figures/risk_coverage.pngOther276.6 KB3c4f82a76f2e
results/qwen35-9b-t1r-s0/figures/risk_coverage.svgOther203.1 KB—
results/qwen35-9b-t1r-s0/figures/vs_cardinality.pngOther163.3 KB79d5e47bebb9
results/qwen35-9b-t1r-s0/figures/vs_cardinality.svgOther43.7 KB—
results/qwen35-9b-t1r-s1/figures/calibration_map.pngOther176.4 KB9b13efb00a25
results/qwen35-9b-t1r-s1/figures/calibration_map.svgOther35.2 KB—
results/qwen35-9b-t1r-s1/figures/human_vs_model.pngOther412.3 KB05f40e6e9284
results/qwen35-9b-t1r-s1/figures/human_vs_model.svgOther4.2 MB—
results/qwen35-9b-t1r-s1/figures/reliability.pngOther513.9 KBa02bc92c6ebe
results/qwen35-9b-t1r-s1/figures/reliability.svgOther250.6 KB—
results/qwen35-9b-t1r-s1/figures/risk_coverage.pngOther272.1 KBf66801be45d5
results/qwen35-9b-t1r-s1/figures/risk_coverage.svgOther201.3 KB—
results/qwen35-9b-t1r-s1/figures/vs_cardinality.pngOther165.4 KBc87a6de6ef70
results/qwen35-9b-t1r-s1/figures/vs_cardinality.svgOther44.8 KB—
results/qwen35-9b-t1r-s2/figures/calibration_map.pngOther178.4 KB1fe04234a898
results/qwen35-9b-t1r-s2/figures/calibration_map.svgOther35.4 KB—
results/qwen35-9b-t1r-s2/figures/human_vs_model.pngOther411.3 KBaa886b063c47
results/qwen35-9b-t1r-s2/figures/human_vs_model.svgOther4.2 MB—
results/qwen35-9b-t1r-s2/figures/reliability.pngOther507.1 KBcf6b45cda1f1
results/qwen35-9b-t1r-s2/figures/reliability.svgOther246.4 KB—
results/qwen35-9b-t1r-s2/figures/risk_coverage.pngOther273.5 KB063278bb3307
results/qwen35-9b-t1r-s2/figures/risk_coverage.svgOther206.1 KB—
results/qwen35-9b-t1r-s2/figures/vs_cardinality.pngOther164.1 KB3581db9c335f
results/qwen35-9b-t1r-s2/figures/vs_cardinality.svgOther44.2 KB—
results/qwen35-9b-vision/figures/calibration_map.pngOther126.0 KB6ecbf0fb3ccf
results/qwen35-9b-vision/figures/calibration_map.svgOther17.8 KB—
results/qwen35-9b-vision/figures/latency.pngOther86.2 KB93c97a45343e
results/qwen35-9b-vision/figures/latency.svgOther26.4 KB—
results/qwen35-9b-vision/figures/reliability.pngOther131.0 KB2eda05e60ae2
results/qwen35-9b-vision/figures/reliability.svgOther38.1 KB—
results/qwen35-9b-vision/figures/risk_coverage.pngOther147.9 KB8810b7756d6b
results/qwen35-9b-vision/figures/risk_coverage.svgOther43.7 KB—
results/qwen35-9b-vision/figures/vs_cardinality.pngOther117.2 KBeb82cc9eaf96
results/qwen35-9b-vision/figures/vs_cardinality.svgOther31.4 KB—
results/qwen35-9b/figures/calibration_map.pngOther181.6 KBf6db53f513de
results/qwen35-9b/figures/calibration_map.svgOther36.4 KB—
results/qwen35-9b/figures/human_vs_model.pngOther412.7 KBb13e055b9536
results/qwen35-9b/figures/human_vs_model.svgOther4.2 MB—
results/qwen35-9b/figures/latency.pngOther88.9 KBef4c6a01bc7e
results/qwen35-9b/figures/latency.svgOther26.9 KB—
results/qwen35-9b/figures/reliability.pngOther509.7 KBbcf97cc307b3
results/qwen35-9b/figures/reliability.svgOther252.3 KB—
results/qwen35-9b/figures/risk_coverage.pngOther274.9 KB14ddc0f23544
results/qwen35-9b/figures/risk_coverage.svgOther196.0 KB—
results/qwen35-9b/figures/vs_cardinality.pngOther165.7 KBe6c7b1682808
results/qwen35-9b/figures/vs_cardinality.svgOther44.2 KB—
results/qwen35-9b/vs_jev/compare_accuracy.pngOther119.8 KB0d5ca028dabe
results/qwen35-9b/vs_jev/compare_accuracy.svgOther29.3 KB—
results/qwen35-9b/vs_jev/compare_ece.pngOther130.4 KBe974d1a6d6ea
results/qwen35-9b/vs_jev/compare_ece.svgOther31.2 KB—
results/qwen3vl-2b-t2-both/figures/calibration_map.pngOther132.3 KBe94019203f03
results/qwen3vl-2b-t2-both/figures/calibration_map.svgOther18.1 KB—
results/qwen3vl-2b-t2-both/figures/latency.pngOther94.2 KB4988a329cce5
results/qwen3vl-2b-t2-both/figures/latency.svgOther26.4 KB—
results/qwen3vl-2b-t2-both/figures/reliability.pngOther134.5 KBbe5ff37fb468
results/qwen3vl-2b-t2-both/figures/reliability.svgOther38.2 KB—
results/qwen3vl-2b-t2-both/figures/risk_coverage.pngOther160.3 KBcfd2d8f05b56
results/qwen3vl-2b-t2-both/figures/risk_coverage.svgOther48.2 KB—
results/qwen3vl-2b-t2-both/figures/vs_cardinality.pngOther130.1 KB3771f00eb41e
results/qwen3vl-2b-t2-both/figures/vs_cardinality.svgOther32.6 KB—
results/qwen3vl-2b-t2-both/lora/adapter_model.safetensorsOther98.8 MB00a4d0f7abc8
results/qwen3vl-2b-t2-decoder/figures/calibration_map.pngOther133.0 KBc4c1115468df
results/qwen3vl-2b-t2-decoder/figures/calibration_map.svgOther18.1 KB—
results/qwen3vl-2b-t2-decoder/figures/latency.pngOther92.1 KBbe090b7ee223
results/qwen3vl-2b-t2-decoder/figures/latency.svgOther25.9 KB—
results/qwen3vl-2b-t2-decoder/figures/reliability.pngOther133.8 KB3c4429ff453c
results/qwen3vl-2b-t2-decoder/figures/reliability.svgOther37.5 KB—
results/qwen3vl-2b-t2-decoder/figures/risk_coverage.pngOther157.9 KB4e0a966bb402
results/qwen3vl-2b-t2-decoder/figures/risk_coverage.svgOther47.9 KB—
results/qwen3vl-2b-t2-decoder/figures/vs_cardinality.pngOther127.5 KBc062f8f2fb10
results/qwen3vl-2b-t2-decoder/figures/vs_cardinality.svgOther32.2 KB—
results/qwen3vl-2b-t2-decoder/lora/adapter_model.safetensorsOther69.8 MB67c56cd13474
results/qwen3vl-2b-t2-vision/figures/calibration_map.pngOther132.3 KBc73bfc7926ed
results/qwen3vl-2b-t2-vision/figures/calibration_map.svgOther18.1 KB—
results/qwen3vl-2b-t2-vision/figures/latency.pngOther91.6 KB4d3735382a05
results/qwen3vl-2b-t2-vision/figures/latency.svgOther25.4 KB—
results/qwen3vl-2b-t2-vision/figures/reliability.pngOther134.8 KB42cef0fb7b0d
results/qwen3vl-2b-t2-vision/figures/reliability.svgOther38.2 KB—
results/qwen3vl-2b-t2-vision/figures/risk_coverage.pngOther161.7 KB4e5ddbde907b
results/qwen3vl-2b-t2-vision/figures/risk_coverage.svgOther50.6 KB—
results/qwen3vl-2b-t2-vision/figures/vs_cardinality.pngOther116.2 KB78c64eab9914
results/qwen3vl-2b-t2-vision/figures/vs_cardinality.svgOther29.1 KB—
results/qwen3vl-2b-t2-vision/lora/adapter_model.safetensorsOther29.0 MBca48bc5a465f
results/qwen3vl-2b/figures/calibration_map.pngOther128.8 KBa173b7fdcd30
results/qwen3vl-2b/figures/calibration_map.svgOther18.0 KB—
results/qwen3vl-2b/figures/latency.pngOther88.3 KB5e0cb04694d3
results/qwen3vl-2b/figures/latency.svgOther26.8 KB—
results/qwen3vl-2b/figures/reliability.pngOther133.3 KB1088a03f5a51
results/qwen3vl-2b/figures/reliability.svgOther38.2 KB—
results/qwen3vl-2b/figures/risk_coverage.pngOther160.7 KB317ff015a234
results/qwen3vl-2b/figures/risk_coverage.svgOther50.7 KB—
results/qwen3vl-2b/figures/vs_cardinality.pngOther112.2 KB032b3e8d8ddb
results/qwen3vl-2b/figures/vs_cardinality.svgOther29.6 KB—
results/qwen3vl-8b/figures/calibration_map.pngOther129.3 KBd1dc1a2fd0a4
results/qwen3vl-8b/figures/calibration_map.svgOther17.8 KB—
results/qwen3vl-8b/figures/latency.pngOther86.7 KBc512719c3f97
results/qwen3vl-8b/figures/latency.svgOther24.9 KB—
results/qwen3vl-8b/figures/reliability.pngOther130.5 KB7b0215570329
results/qwen3vl-8b/figures/reliability.svgOther37.4 KB—
results/qwen3vl-8b/figures/risk_coverage.pngOther151.2 KB8c32daf97f82
results/qwen3vl-8b/figures/risk_coverage.svgOther43.8 KB—
results/qwen3vl-8b/figures/vs_cardinality.pngOther120.3 KB3d17c36140f0
results/qwen3vl-8b/figures/vs_cardinality.svgOther30.5 KB—
results/recipe-k/recipe_k.pngOther174.5 KBbb655b533b78
results/recipe-k/recipe_k.svgOther22.9 KB—
results/smollm3-3b/figures/calibration_map.pngOther184.6 KB94551e5b1ade
results/smollm3-3b/figures/calibration_map.svgOther36.9 KB—
results/smollm3-3b/figures/human_vs_model.pngOther403.5 KB2d38e780f977
results/smollm3-3b/figures/human_vs_model.svgOther4.2 MB—
results/smollm3-3b/figures/latency.pngOther85.7 KB27415425eee7
results/smollm3-3b/figures/latency.svgOther26.4 KB—
results/smollm3-3b/figures/reliability.pngOther514.1 KBe367b5291012
results/smollm3-3b/figures/reliability.svgOther244.7 KB—
results/smollm3-3b/figures/risk_coverage.pngOther286.9 KB50ae27f5d810
results/smollm3-3b/figures/risk_coverage.svgOther225.4 KB—
results/smollm3-3b/figures/vs_cardinality.pngOther168.6 KB4b3b2a81ff0c
results/smollm3-3b/figures/vs_cardinality.svgOther44.7 KB—
results/smollm3-3b/vs_jev/compare_accuracy.pngOther122.9 KBd0b03f69a1cb
results/smollm3-3b/vs_jev/compare_accuracy.svgOther29.4 KB—
results/smollm3-3b/vs_jev/compare_ece.pngOther133.1 KBb046114f7612
results/smollm3-3b/vs_jev/compare_ece.svgOther31.2 KB—
results/tev1-4b-jevfmt/figures/calibration_map.pngOther188.8 KB11e36badddb7
results/tev1-4b-jevfmt/figures/calibration_map.svgOther35.9 KB—
results/tev1-4b-jevfmt/figures/human_vs_model.pngOther415.9 KB377d541e4a7e
results/tev1-4b-jevfmt/figures/human_vs_model.svgOther4.2 MB—
results/tev1-4b-jevfmt/figures/latency.pngOther90.8 KBa1d1b021ab9e
results/tev1-4b-jevfmt/figures/latency.svgOther24.4 KB—
results/tev1-4b-jevfmt/figures/reliability.pngOther523.3 KB84b753e00c2f
results/tev1-4b-jevfmt/figures/reliability.svgOther250.4 KB—
results/tev1-4b-jevfmt/figures/risk_coverage.pngOther273.0 KB2f30021528e6
results/tev1-4b-jevfmt/figures/risk_coverage.svgOther193.3 KB—
results/tev1-4b-jevfmt/figures/vs_cardinality.pngOther180.1 KBa8c7d024f008
results/tev1-4b-jevfmt/figures/vs_cardinality.svgOther45.0 KB—
results/tev1-4b-jevfmt/vs_jev/compare_accuracy.pngOther130.3 KB443fcbe9a0b5
results/tev1-4b-jevfmt/vs_jev/compare_accuracy.svgOther29.2 KB—
results/tev1-4b-jevfmt/vs_jev/compare_ece.pngOther140.0 KB0837a95f8a7d
results/tev1-4b-jevfmt/vs_jev/compare_ece.svgOther30.8 KB—
results/tev1-4b/figures/calibration_map.pngOther190.3 KBcd106cb0e7e6
results/tev1-4b/figures/calibration_map.svgOther35.7 KB—
results/tev1-4b/figures/human_vs_model.pngOther423.4 KB88003a2dab0c
results/tev1-4b/figures/human_vs_model.svgOther4.2 MB—
results/tev1-4b/figures/latency.pngOther92.8 KBb5af442ecfba
results/tev1-4b/figures/latency.svgOther24.9 KB—
results/tev1-4b/figures/reliability.pngOther527.7 KB8aa496547602
results/tev1-4b/figures/reliability.svgOther251.1 KB—
results/tev1-4b/figures/risk_coverage.pngOther268.7 KB90b32301e974
results/tev1-4b/figures/risk_coverage.svgOther190.9 KB—
results/tev1-4b/figures/vs_cardinality.pngOther177.5 KB099f439385ec
results/tev1-4b/figures/vs_cardinality.svgOther44.8 KB—
results/tev1-4b/vs_jev/compare_accuracy.pngOther133.2 KBc1d1b26e36db
results/tev1-4b/vs_jev/compare_accuracy.svgOther29.5 KB—
results/tev1-4b/vs_jev/compare_ece.pngOther141.4 KBf55996d5de2b
results/tev1-4b/vs_jev/compare_ece.svgOther31.3 KB—
results/tev1-comparison/tev1_subsets.pngOther174.4 KB948594ef57f8
results/tev1-comparison/tev1_subsets.svgOther35.3 KB—
results/vision-budget/vision_budget.pngOther137.6 KB2023921fb97d
.gitattributesRepository7.5 KB—

License and Download

License
other
Access
No access gate
Download from Praveen Raj U S

Released by Praveen Raj U S through its official repository on Hugging Face. Read the license.

Models Trained on This Dataset