Llama-3.2-3B-vrank-vs-attn is an open-weight model from Sehyun Park. Its published files total 242.5 MB.
Parameters—
Context—
Weights241.9 MB
License—
AccessOpen weights
Monthly Downloads—
Model Card
The publisher has not written a card for this model.
Identity and Version
- Repository
- sehyun734/Llama-3.2-3B-vrank-vs-attn
- Publisher
- Sehyun Park
- Task
- Not stated by the source
- Modality
- Other
- Library
- Not stated by the source
- Parameters
- Not stated by the source
- Languages
- Not stated by the source
- Revision
- 03201a9948d1aea2ebee85e84aaba7deebc8c3aa
- First published
- 2026-09-29
- Last updated
- 2026-09-30
Files and Weights
41 files, 242.5 MB in total. The weights are 8 files totalling 241.9 MB in safetensors.
Weights8 files · 241.9 MB
Configuration32 files · 522.3 KB
Repository1 file · 1.5 KB
Every file
| File | Type | Size | SHA-256 |
|---|---|---|---|
| lora/rank=16,lr=0.001,seed=0/lora.safetensors | Weights | 25.7 MB | 55ee2b7b5e48 |
| lora/rank=4,lr=0.001,seed=0/lora.safetensors | Weights | 6.4 MB | 722bff8635b1 |
| lora/rank=64,lr=0.001,seed=0/lora.safetensors | Weights | 102.8 MB | 72dceed2cff2 |
| prefix/prefix_len=16,lr=0.001,seed=0/prefix.safetensors | Weights | 3.8 MB | 603d827d0808 |
| prefix/prefix_len=256,lr=0.001,seed=0/prefix.safetensors | Weights | 58.8 MB | e4b60528ace7 |
| prefix/prefix_len=64,lr=0.001,seed=0/prefix.safetensors | Weights | 14.8 MB | e6b33ed8a810 |
| prefix/prefix_len=64,lr=0.003,seed=0/prefix.safetensors | Weights | 14.8 MB | 688d3df68940 |
| prefix/prefix_len=64,lr=0.01,seed=0/prefix.safetensors | Weights | 14.8 MB | 6e7a68bd0ff1 |
| base/attn.json | Configuration | 43.1 KB | — |
| base/config.json | Configuration | 98 B | — |
| base/gsm8k.json | Configuration | 32 B | — |
| base/vrank.json | Configuration | 9.7 KB | — |
| lora/rank=16,lr=0.001,seed=0/attn.json | Configuration | 54.0 KB | — |
| lora/rank=16,lr=0.001,seed=0/config.json | Configuration | 275 B | — |
| lora/rank=16,lr=0.001,seed=0/gsm8k.json | Configuration | 31 B | — |
| lora/rank=16,lr=0.001,seed=0/vrank.json | Configuration | 9.7 KB | — |
| lora/rank=4,lr=0.001,seed=0/attn.json | Configuration | 54.0 KB | — |
| lora/rank=4,lr=0.001,seed=0/config.json | Configuration | 274 B | — |
| lora/rank=4,lr=0.001,seed=0/gsm8k.json | Configuration | 31 B | — |
| lora/rank=4,lr=0.001,seed=0/vrank.json | Configuration | 9.7 KB | — |
| lora/rank=64,lr=0.001,seed=0/attn.json | Configuration | 54.0 KB | — |
| lora/rank=64,lr=0.001,seed=0/config.json | Configuration | 275 B | — |
| lora/rank=64,lr=0.001,seed=0/gsm8k.json | Configuration | 31 B | — |
| lora/rank=64,lr=0.001,seed=0/vrank.json | Configuration | 9.7 KB | — |
| prefix/prefix_len=16,lr=0.001,seed=0/attn.json | Configuration | 73.0 KB | — |
| prefix/prefix_len=16,lr=0.001,seed=0/config.json | Configuration | 265 B | — |
| prefix/prefix_len=16,lr=0.001,seed=0/gsm8k.json | Configuration | 31 B | — |
| prefix/prefix_len=16,lr=0.001,seed=0/vrank.json | Configuration | 19.1 KB | — |
| prefix/prefix_len=256,lr=0.001,seed=0/attn.json | Configuration | 72.6 KB | — |
| prefix/prefix_len=256,lr=0.001,seed=0/config.json | Configuration | 266 B | — |
| prefix/prefix_len=256,lr=0.001,seed=0/gsm8k.json | Configuration | 32 B | — |
| prefix/prefix_len=256,lr=0.001,seed=0/vrank.json | Configuration | 19.2 KB | — |
| prefix/prefix_len=64,lr=0.001,seed=0/attn.json | Configuration | 72.7 KB | — |
| prefix/prefix_len=64,lr=0.001,seed=0/config.json | Configuration | 265 B | — |
| prefix/prefix_len=64,lr=0.001,seed=0/gsm8k.json | Configuration | 31 B | — |
| prefix/prefix_len=64,lr=0.001,seed=0/vrank.json | Configuration | 19.2 KB | — |
| prefix/prefix_len=64,lr=0.003,seed=0/config.json | Configuration | 265 B | — |
| prefix/prefix_len=64,lr=0.003,seed=0/gsm8k.json | Configuration | 31 B | — |
| prefix/prefix_len=64,lr=0.01,seed=0/config.json | Configuration | 264 B | — |
| prefix/prefix_len=64,lr=0.01,seed=0/gsm8k.json | Configuration | 30 B | — |
| .gitattributes | Repository | 1.5 KB | — |
License and Download
- License
- Not stated by the source
- Access
- Open weights, no gate
- Download size
- 241.9 MB
Download from Sehyun Park
Released by Sehyun Park through its official repository on Hugging Face.
Memory Requirements
| Precision | Weights in memory |
|---|---|
| As published | 241.9 MB |
Weights only, from the published parameter count; the key-value cache and runtime add to this.