Skip to page content
SAVRN
Search Plan a project

Open-weight model

vrank-vs-attn

by Sehyun Park sehyun734/vrank-vs-attn

vrank-vs-attn is an open-weight model from Sehyun Park. Its published files total 741.0 MB.

Parameters—
Context—
Weights738.8 MB
License—
AccessOpen weights
Monthly Downloads—

Model Card

The publisher has not written a card for this model.

Identity and Version

Repository
sehyun734/vrank-vs-attn
Publisher
Sehyun Park
Task
Not stated by the source
Modality
Other
Library
Not stated by the source
Parameters
Not stated by the source
Languages
Not stated by the source
Revision
fe52d11f39271196f6716ba04165d0f71e6e88b5
First published
2026-10-07
Last updated
2026-10-07

Files and Weights

151 files, 741.0 MB in total. The weights are 40 files totalling 738.8 MB in safetensors.

Weights40 files · 738.8 MB
Configuration110 files · 2.1 MB
Repository1 file · 1.5 KB
Every file
FileTypeSizeSHA-256
lora/Llama-3.2-1B/rank=16,learning_rate=0.0001,seed=0/lora.safetensorsWeights9.4 MB c3897a690afb
lora/Llama-3.2-1B/rank=16,learning_rate=0.0003,seed=0/lora.safetensorsWeights9.4 MB f27a88623ddb
lora/Llama-3.2-1B/rank=16,learning_rate=0.001,seed=0/lora.safetensorsWeights9.4 MB a5e593360df7
lora/Llama-3.2-1B/rank=16,learning_rate=0.003,seed=0/lora.safetensorsWeights9.4 MB 4d11bc105b51
lora/Llama-3.2-1B/rank=4,learning_rate=0.0001,seed=0/lora.safetensorsWeights2.4 MB ca472e0367d0
lora/Llama-3.2-1B/rank=4,learning_rate=0.0003,seed=0/lora.safetensorsWeights2.4 MB dead38f725a4
lora/Llama-3.2-1B/rank=4,learning_rate=0.001,seed=0/lora.safetensorsWeights2.4 MB 4de2fb48cfe5
lora/Llama-3.2-1B/rank=4,learning_rate=0.003,seed=0/lora.safetensorsWeights2.4 MB 2e358a9a2f95
lora/Llama-3.2-1B/rank=64,learning_rate=0.0001,seed=0/lora.safetensorsWeights37.8 MB 47215a1d7a93
lora/Llama-3.2-1B/rank=64,learning_rate=0.0003,seed=0/lora.safetensorsWeights37.8 MB 3351d4be5529
lora/Llama-3.2-1B/rank=64,learning_rate=0.001,seed=0/lora.safetensorsWeights37.8 MB d4aa9427e8bc
lora/Llama-3.2-1B/rank=64,learning_rate=0.003,seed=0/lora.safetensorsWeights37.8 MB 37fd4cd40f0e
lora/Llama-3.2-3B/rank=16,learning_rate=0.0003,seed=0/lora.safetensorsWeights25.7 MB 948f05f1a81b
lora/Llama-3.2-3B/rank=16,learning_rate=0.001,seed=0/lora.safetensorsWeights25.7 MB d14804ad2f49
lora/Llama-3.2-3B/rank=16,learning_rate=0.003,seed=0/lora.safetensorsWeights25.7 MB 931c298700bc
lora/Llama-3.2-3B/rank=4,learning_rate=0.001,seed=0/lora.safetensorsWeights6.4 MB 516faeb36311
lora/Llama-3.2-3B/rank=64,learning_rate=0.001,seed=0/lora.safetensorsWeights102.8 MB 43280abf76e9
lora/Qwen3-0.6B-Base/rank=16,learning_rate=0.0001,seed=0/lora.safetensorsWeights12.9 MB 26034c09a091
lora/Qwen3-0.6B-Base/rank=16,learning_rate=0.0003,seed=0/lora.safetensorsWeights12.9 MB fffff9917d1c
lora/Qwen3-0.6B-Base/rank=16,learning_rate=0.001,seed=0/lora.safetensorsWeights12.9 MB 983c346b60c1
lora/Qwen3-0.6B-Base/rank=16,learning_rate=0.003,seed=0/lora.safetensorsWeights12.9 MB 065f5b018f58
lora/Qwen3-0.6B-Base/rank=4,learning_rate=0.0001,seed=0/lora.safetensorsWeights3.2 MB 64abb276c3cb
lora/Qwen3-0.6B-Base/rank=4,learning_rate=0.0003,seed=0/lora.safetensorsWeights3.2 MB dc0bcdea8d3e
lora/Qwen3-0.6B-Base/rank=4,learning_rate=0.001,seed=0/lora.safetensorsWeights3.2 MB 2d819bb8c65b
lora/Qwen3-0.6B-Base/rank=4,learning_rate=0.003,seed=0/lora.safetensorsWeights3.2 MB 2bb2f6ff447e
lora/Qwen3-0.6B-Base/rank=64,learning_rate=0.0001,seed=0/lora.safetensorsWeights51.4 MB 0501d88e5bd0
lora/Qwen3-0.6B-Base/rank=64,learning_rate=0.0003,seed=0/lora.safetensorsWeights51.4 MB fe8b752182c8
lora/Qwen3-0.6B-Base/rank=64,learning_rate=0.001,seed=0/lora.safetensorsWeights51.4 MB 1a42072d900f
lora/Qwen3-0.6B-Base/rank=64,learning_rate=0.003,seed=0/lora.safetensorsWeights51.4 MB 5dd93979c42b
prefix/Llama-3.2-1B/prefix_len=16,learning_rate=0.0001,seed=0/prefix.safetensorsWeights1.1 MB caf0116557d7
prefix/Llama-3.2-1B/prefix_len=16,learning_rate=0.0003,seed=0/prefix.safetensorsWeights1.1 MB 8fc34359c2bc
prefix/Llama-3.2-1B/prefix_len=16,learning_rate=0.001,seed=0/prefix.safetensorsWeights1.1 MB b70d7bd448da
prefix/Llama-3.2-1B/prefix_len=16,learning_rate=0.003,seed=0/prefix.safetensorsWeights1.1 MB d657abef9a9d
prefix/Llama-3.2-1B/prefix_len=256,learning_rate=0.0001,seed=0/prefix.safetensorsWeights16.8 MB ad19bdaab59e
prefix/Llama-3.2-1B/prefix_len=256,learning_rate=0.0003,seed=0/prefix.safetensorsWeights16.8 MB f46f46bccf34
prefix/Llama-3.2-1B/prefix_len=256,learning_rate=0.001,seed=0/prefix.safetensorsWeights16.8 MB 2c044be3287d
prefix/Llama-3.2-1B/prefix_len=256,learning_rate=0.002,seed=0/prefix.safetensorsWeights16.8 MB 4b4cd73230af
prefix/Llama-3.2-1B/prefix_len=64,learning_rate=0.0001,seed=0/prefix.safetensorsWeights4.2 MB 4b6c56755950
prefix/Llama-3.2-1B/prefix_len=64,learning_rate=0.0003,seed=0/prefix.safetensorsWeights4.2 MB 9e4ad974f882
prefix/Llama-3.2-1B/prefix_len=64,learning_rate=0.001,seed=0/prefix.safetensorsWeights4.2 MB 475e420e1d46
attn/base/Llama-3.2-1B/num_samples=256.jsonConfiguration32.6 KB —
attn/base/Llama-3.2-3B/num_samples=256.jsonConfiguration42.9 KB —
attn/base/Qwen3-0.6B-Base/num_samples=256.jsonConfiguration29.1 KB —
attn/lora/Llama-3.2-1B/rank=16,learning_rate=0.0001,seed=0/num_samples=256.jsonConfiguration41.0 KB —
attn/lora/Llama-3.2-1B/rank=16,learning_rate=0.0003,seed=0/num_samples=256.jsonConfiguration41.0 KB —
attn/lora/Llama-3.2-1B/rank=16,learning_rate=0.001,seed=0/num_samples=256.jsonConfiguration40.9 KB —
attn/lora/Llama-3.2-1B/rank=16,learning_rate=0.003,seed=0/num_samples=256.jsonConfiguration40.7 KB —
attn/lora/Llama-3.2-1B/rank=4,learning_rate=0.0001,seed=0/num_samples=256.jsonConfiguration41.1 KB —
attn/lora/Llama-3.2-1B/rank=4,learning_rate=0.0003,seed=0/num_samples=256.jsonConfiguration40.9 KB —
attn/lora/Llama-3.2-1B/rank=4,learning_rate=0.001,seed=0/num_samples=256.jsonConfiguration40.9 KB —
attn/lora/Llama-3.2-1B/rank=4,learning_rate=0.003,seed=0/num_samples=256.jsonConfiguration40.8 KB —
attn/lora/Llama-3.2-1B/rank=64,learning_rate=0.0001,seed=0/num_samples=256.jsonConfiguration40.9 KB —
attn/lora/Llama-3.2-1B/rank=64,learning_rate=0.0003,seed=0/num_samples=256.jsonConfiguration40.9 KB —
attn/lora/Llama-3.2-1B/rank=64,learning_rate=0.001,seed=0/num_samples=256.jsonConfiguration40.9 KB —
attn/lora/Llama-3.2-1B/rank=64,learning_rate=0.003,seed=0/num_samples=256.jsonConfiguration40.7 KB —
attn/lora/Llama-3.2-3B/rank=16,learning_rate=0.0003,seed=0/num_samples=256.jsonConfiguration53.9 KB —
attn/lora/Llama-3.2-3B/rank=16,learning_rate=0.001,seed=0/num_samples=256.jsonConfiguration53.8 KB —
attn/lora/Llama-3.2-3B/rank=16,learning_rate=0.003,seed=0/num_samples=256.jsonConfiguration53.5 KB —
attn/lora/Llama-3.2-3B/rank=4,learning_rate=0.001,seed=0/num_samples=256.jsonConfiguration53.9 KB —
attn/lora/Llama-3.2-3B/rank=64,learning_rate=0.001,seed=0/num_samples=256.jsonConfiguration53.7 KB —
attn/lora/Qwen3-0.6B-Base/rank=16,learning_rate=0.0001,seed=0/num_samples=256.jsonConfiguration36.7 KB —
attn/lora/Qwen3-0.6B-Base/rank=16,learning_rate=0.0003,seed=0/num_samples=256.jsonConfiguration36.6 KB —
attn/lora/Qwen3-0.6B-Base/rank=16,learning_rate=0.001,seed=0/num_samples=256.jsonConfiguration36.5 KB —
attn/lora/Qwen3-0.6B-Base/rank=16,learning_rate=0.003,seed=0/num_samples=256.jsonConfiguration36.4 KB —
attn/lora/Qwen3-0.6B-Base/rank=4,learning_rate=0.0001,seed=0/num_samples=256.jsonConfiguration36.7 KB —
attn/lora/Qwen3-0.6B-Base/rank=4,learning_rate=0.0003,seed=0/num_samples=256.jsonConfiguration36.7 KB —
attn/lora/Qwen3-0.6B-Base/rank=4,learning_rate=0.001,seed=0/num_samples=256.jsonConfiguration36.6 KB —
attn/lora/Qwen3-0.6B-Base/rank=4,learning_rate=0.003,seed=0/num_samples=256.jsonConfiguration36.4 KB —
attn/lora/Qwen3-0.6B-Base/rank=64,learning_rate=0.0001,seed=0/num_samples=256.jsonConfiguration36.6 KB —
attn/lora/Qwen3-0.6B-Base/rank=64,learning_rate=0.0003,seed=0/num_samples=256.jsonConfiguration36.6 KB —
attn/lora/Qwen3-0.6B-Base/rank=64,learning_rate=0.001,seed=0/num_samples=256.jsonConfiguration36.4 KB —
attn/lora/Qwen3-0.6B-Base/rank=64,learning_rate=0.003,seed=0/num_samples=256.jsonConfiguration36.7 KB —
attn/prefix/Llama-3.2-1B/prefix_len=16,learning_rate=0.0001,seed=0/num_samples=256.jsonConfiguration55.2 KB —
attn/prefix/Llama-3.2-1B/prefix_len=16,learning_rate=0.0003,seed=0/num_samples=256.jsonConfiguration55.2 KB —
attn/prefix/Llama-3.2-1B/prefix_len=16,learning_rate=0.001,seed=0/num_samples=256.jsonConfiguration55.2 KB —
attn/prefix/Llama-3.2-1B/prefix_len=16,learning_rate=0.003,seed=0/num_samples=256.jsonConfiguration54.7 KB —
attn/prefix/Llama-3.2-1B/prefix_len=256,learning_rate=0.0001,seed=0/num_samples=256.jsonConfiguration55.1 KB —
attn/prefix/Llama-3.2-1B/prefix_len=256,learning_rate=0.0003,seed=0/num_samples=256.jsonConfiguration55.0 KB —
attn/prefix/Llama-3.2-1B/prefix_len=256,learning_rate=0.001,seed=0/num_samples=256.jsonConfiguration55.0 KB —
attn/prefix/Llama-3.2-1B/prefix_len=256,learning_rate=0.002,seed=0/num_samples=256.jsonConfiguration55.2 KB —
attn/prefix/Llama-3.2-1B/prefix_len=64,learning_rate=0.0001,seed=0/num_samples=256.jsonConfiguration55.1 KB —
attn/prefix/Llama-3.2-1B/prefix_len=64,learning_rate=0.0003,seed=0/num_samples=256.jsonConfiguration55.1 KB —
attn/prefix/Llama-3.2-1B/prefix_len=64,learning_rate=0.001,seed=0/num_samples=256.jsonConfiguration55.1 KB —
gsm8k/base/Llama-3.2-1B/num_samples=1319.jsonConfiguration38 B —
gsm8k/base/Llama-3.2-3B/num_samples=1319.jsonConfiguration37 B —
gsm8k/base/Qwen3-0.6B-Base/num_samples=1319.jsonConfiguration36 B —
gsm8k/lora/Llama-3.2-1B/rank=16,learning_rate=0.0001,seed=0/num_samples=1319.jsonConfiguration37 B —
gsm8k/lora/Llama-3.2-1B/rank=16,learning_rate=0.0003,seed=0/num_samples=1319.jsonConfiguration37 B —
gsm8k/lora/Llama-3.2-1B/rank=16,learning_rate=0.001,seed=0/num_samples=1319.jsonConfiguration36 B —
gsm8k/lora/Llama-3.2-1B/rank=16,learning_rate=0.003,seed=0/num_samples=1319.jsonConfiguration37 B —
gsm8k/lora/Llama-3.2-1B/rank=4,learning_rate=0.0001,seed=0/num_samples=1319.jsonConfiguration37 B —
gsm8k/lora/Llama-3.2-1B/rank=4,learning_rate=0.0003,seed=0/num_samples=1319.jsonConfiguration37 B —
gsm8k/lora/Llama-3.2-1B/rank=4,learning_rate=0.001,seed=0/num_samples=1319.jsonConfiguration37 B —
gsm8k/lora/Llama-3.2-1B/rank=4,learning_rate=0.003,seed=0/num_samples=1319.jsonConfiguration36 B —
gsm8k/lora/Llama-3.2-1B/rank=64,learning_rate=0.0001,seed=0/num_samples=1319.jsonConfiguration37 B —
gsm8k/lora/Llama-3.2-1B/rank=64,learning_rate=0.0003,seed=0/num_samples=1319.jsonConfiguration37 B —
gsm8k/lora/Llama-3.2-1B/rank=64,learning_rate=0.001,seed=0/num_samples=1319.jsonConfiguration37 B —
gsm8k/lora/Llama-3.2-1B/rank=64,learning_rate=0.003,seed=0/num_samples=1319.jsonConfiguration38 B —
gsm8k/lora/Llama-3.2-3B/rank=16,learning_rate=0.0003,seed=0/num_samples=1319.jsonConfiguration36 B —
gsm8k/lora/Llama-3.2-3B/rank=16,learning_rate=0.001,seed=0/num_samples=1319.jsonConfiguration36 B —
gsm8k/lora/Llama-3.2-3B/rank=16,learning_rate=0.003,seed=0/num_samples=1319.jsonConfiguration38 B —
gsm8k/lora/Llama-3.2-3B/rank=4,learning_rate=0.001,seed=0/num_samples=1319.jsonConfiguration36 B —
gsm8k/lora/Llama-3.2-3B/rank=64,learning_rate=0.001,seed=0/num_samples=1319.jsonConfiguration36 B —
gsm8k/lora/Qwen3-0.6B-Base/rank=16,learning_rate=0.0001,seed=0/num_samples=1319.jsonConfiguration36 B —
gsm8k/lora/Qwen3-0.6B-Base/rank=16,learning_rate=0.0003,seed=0/num_samples=1319.jsonConfiguration36 B —
gsm8k/lora/Qwen3-0.6B-Base/rank=16,learning_rate=0.001,seed=0/num_samples=1319.jsonConfiguration35 B —
gsm8k/lora/Qwen3-0.6B-Base/rank=16,learning_rate=0.003,seed=0/num_samples=1319.jsonConfiguration36 B —
gsm8k/lora/Qwen3-0.6B-Base/rank=4,learning_rate=0.0001,seed=0/num_samples=1319.jsonConfiguration36 B —
gsm8k/lora/Qwen3-0.6B-Base/rank=4,learning_rate=0.0003,seed=0/num_samples=1319.jsonConfiguration36 B —
gsm8k/lora/Qwen3-0.6B-Base/rank=4,learning_rate=0.001,seed=0/num_samples=1319.jsonConfiguration35 B —
gsm8k/lora/Qwen3-0.6B-Base/rank=4,learning_rate=0.003,seed=0/num_samples=1319.jsonConfiguration36 B —
gsm8k/lora/Qwen3-0.6B-Base/rank=64,learning_rate=0.0001,seed=0/num_samples=1319.jsonConfiguration36 B —
gsm8k/lora/Qwen3-0.6B-Base/rank=64,learning_rate=0.0003,seed=0/num_samples=1319.jsonConfiguration36 B —
gsm8k/lora/Qwen3-0.6B-Base/rank=64,learning_rate=0.001,seed=0/num_samples=1319.jsonConfiguration36 B —
gsm8k/lora/Qwen3-0.6B-Base/rank=64,learning_rate=0.003,seed=0/num_samples=1319.jsonConfiguration38 B —
gsm8k/prefix/Llama-3.2-1B/prefix_len=16,learning_rate=0.0001,seed=0/num_samples=1319.jsonConfiguration37 B —
gsm8k/prefix/Llama-3.2-1B/prefix_len=16,learning_rate=0.0003,seed=0/num_samples=1319.jsonConfiguration37 B —
gsm8k/prefix/Llama-3.2-1B/prefix_len=16,learning_rate=0.001,seed=0/num_samples=1319.jsonConfiguration36 B —
gsm8k/prefix/Llama-3.2-1B/prefix_len=16,learning_rate=0.003,seed=0/num_samples=1319.jsonConfiguration38 B —
gsm8k/prefix/Llama-3.2-1B/prefix_len=256,learning_rate=0.0001,seed=0/num_samples=1319.jsonConfiguration37 B —
gsm8k/prefix/Llama-3.2-1B/prefix_len=256,learning_rate=0.0003,seed=0/num_samples=1319.jsonConfiguration36 B —
gsm8k/prefix/Llama-3.2-1B/prefix_len=256,learning_rate=0.001,seed=0/num_samples=1319.jsonConfiguration36 B —
gsm8k/prefix/Llama-3.2-1B/prefix_len=256,learning_rate=0.002,seed=0/num_samples=1319.jsonConfiguration37 B —
gsm8k/prefix/Llama-3.2-1B/prefix_len=64,learning_rate=0.0001,seed=0/num_samples=1319.jsonConfiguration37 B —
gsm8k/prefix/Llama-3.2-1B/prefix_len=64,learning_rate=0.0003,seed=0/num_samples=1319.jsonConfiguration35 B —
gsm8k/prefix/Llama-3.2-1B/prefix_len=64,learning_rate=0.001,seed=0/num_samples=1319.jsonConfiguration35 B —
vrank/base/Llama-3.2-1B/num_samples=256.jsonConfiguration6.1 KB —
vrank/lora/Llama-3.2-1B/rank=16,learning_rate=0.0001,seed=0/num_samples=256.jsonConfiguration6.1 KB —
vrank/lora/Llama-3.2-1B/rank=16,learning_rate=0.0003,seed=0/num_samples=256.jsonConfiguration6.1 KB —
vrank/lora/Llama-3.2-1B/rank=16,learning_rate=0.001,seed=0/num_samples=256.jsonConfiguration6.1 KB —
vrank/lora/Llama-3.2-1B/rank=16,learning_rate=0.003,seed=0/num_samples=256.jsonConfiguration6.1 KB —
vrank/lora/Llama-3.2-1B/rank=4,learning_rate=0.0001,seed=0/num_samples=256.jsonConfiguration6.1 KB —
vrank/lora/Llama-3.2-1B/rank=4,learning_rate=0.0003,seed=0/num_samples=256.jsonConfiguration6.1 KB —
vrank/lora/Llama-3.2-1B/rank=4,learning_rate=0.001,seed=0/num_samples=256.jsonConfiguration6.1 KB —
vrank/lora/Llama-3.2-1B/rank=4,learning_rate=0.003,seed=0/num_samples=256.jsonConfiguration6.1 KB —
vrank/lora/Llama-3.2-1B/rank=64,learning_rate=0.0001,seed=0/num_samples=256.jsonConfiguration6.1 KB —
vrank/lora/Llama-3.2-1B/rank=64,learning_rate=0.0003,seed=0/num_samples=256.jsonConfiguration6.1 KB —
vrank/lora/Llama-3.2-1B/rank=64,learning_rate=0.001,seed=0/num_samples=256.jsonConfiguration6.1 KB —
vrank/lora/Llama-3.2-1B/rank=64,learning_rate=0.003,seed=0/num_samples=256.jsonConfiguration5.6 KB —
vrank/prefix/Llama-3.2-1B/prefix_len=16,learning_rate=0.0001,seed=0/num_samples=256.jsonConfiguration11.3 KB —
vrank/prefix/Llama-3.2-1B/prefix_len=16,learning_rate=0.0003,seed=0/num_samples=256.jsonConfiguration11.3 KB —
vrank/prefix/Llama-3.2-1B/prefix_len=16,learning_rate=0.001,seed=0/num_samples=256.jsonConfiguration11.3 KB —
vrank/prefix/Llama-3.2-1B/prefix_len=16,learning_rate=0.003,seed=0/num_samples=256.jsonConfiguration11.2 KB —
vrank/prefix/Llama-3.2-1B/prefix_len=256,learning_rate=0.0001,seed=0/num_samples=256.jsonConfiguration11.4 KB —
vrank/prefix/Llama-3.2-1B/prefix_len=256,learning_rate=0.0003,seed=0/num_samples=256.jsonConfiguration11.4 KB —
vrank/prefix/Llama-3.2-1B/prefix_len=256,learning_rate=0.001,seed=0/num_samples=256.jsonConfiguration11.4 KB —
vrank/prefix/Llama-3.2-1B/prefix_len=256,learning_rate=0.002,seed=0/num_samples=256.jsonConfiguration11.3 KB —
vrank/prefix/Llama-3.2-1B/prefix_len=64,learning_rate=0.0001,seed=0/num_samples=256.jsonConfiguration11.4 KB —
vrank/prefix/Llama-3.2-1B/prefix_len=64,learning_rate=0.0003,seed=0/num_samples=256.jsonConfiguration11.4 KB —
vrank/prefix/Llama-3.2-1B/prefix_len=64,learning_rate=0.001,seed=0/num_samples=256.jsonConfiguration11.4 KB —
.gitattributesRepository1.5 KB —

License and Download

License
Not stated by the source
Access
Open weights, no gate
Download size
738.8 MB
Download from Sehyun Park

Released by Sehyun Park through its official repository on Hugging Face.

Memory Requirements

PrecisionWeights in memory
As published738.8 MB

Weights only, from the published parameter count; the key-value cache and runtime add to this.