Skip to page content
SAVRN
Search Plan a project

Open-weight model

reading-zero-shot-transfer

by Marcus S. marcussari/reading-zero-shot-transfer

reading-zero-shot-transfer is an open-weight model from Marcus S., released under MIT License. It has 16,576 parameters and a 256-token context. At 16-bit it needs about 0 GB of GPU memory, which fits on 1x MI300X from $1.85 an hour, at the lowest prices in the SAVRN Index.

Reading notes and an experiment sketch for Zero Shot Transfer. The repository emphasizes what still needs to be tested instead of manufacturing scores or release claims.

Parameters16,576
Context256
Weights66.8 KB
Licensemit
AccessOpen weights
Monthly Downloads—

Runs On

What it takes to serve reading-zero-shot-transfer (16,576 parameters): the memory its weights need at each precision, and the cheapest way to rent enough data-center GPUs to hold them.

PrecisionWeightsMemory neededCheapest setupPer hourAlso fits
16-bit 0.0 GB 0.0 GB 1x MI300X (192 GB)
Vultr
$1.85 1x H100 $1.99 · 1x MI325X $2.00
8-bit 0.0 GB 0.0 GB 1x MI300X (192 GB)
Vultr
$1.85 1x H100 $1.99 · 1x MI325X $2.00
4-bit 0.0 GB 0.0 GB 1x MI300X (192 GB)
Vultr
$1.85 1x H100 $1.99 · 1x MI325X $2.00

Memory is the weights at that precision plus 20% for the runtime and a short context; a long context needs more. Prices are the lowest on-demand hourly rates in the SAVRN Index, read Oct 18, 2026.

reading-zero-shot-transfer on every accelerator the SAVRN Index prices, at every precision

Model Card

By Marcus S., published under mit, revision 7727861c6bcc.

Reading notes and an experiment sketch for Zero Shot Transfer. The repository emphasizes what still needs to be tested instead of manufacturing scores or release claims. - the scope of the research question and likely confounders - a proposed comparison with matched baselines - concrete evaluation context such as task-appropriate public benchmarks named in the main note - reproducibility checks, failure modes, and open questions - topic-relevant references Start with summary.md for the full note. Sections labeled as plans or hypotheses should not be interpreted as experimental results. If results are added later, they should include dataset versions, commands, seeds, hardware, and raw logs.…

Read Marcus S.'s full model card

Notes on Zero Shot Transfer

Repository summary

Reading notes and an experiment sketch for Zero Shot Transfer. The repository emphasizes what still needs to be tested instead of manufacturing scores or release claims.

What is covered

  • the scope of the research question and likely confounders
  • a proposed comparison with matched baselines
  • concrete evaluation context such as task-appropriate public benchmarks named in the main note
  • reproducibility checks, failure modes, and open questions
  • topic-relevant references

How to read this repository

Start with summary.md for the full note. Sections labeled as plans or hypotheses should not be interpreted as experimental results. If results are added later, they should include dataset versions, commands, seeds, hardware, and raw logs.

Scope and limitations

The note is intentionally exploratory. It does not claim benchmark improvements, completed ablations, released code, or a trained checkpoint. References and proposed datasets provide a starting point for verification rather than evidence that the study has already been run.

Files

  • summary.md — primary artifact
  • README.md — this documentation

License

Released under mit. Review the source-data terms separately when this repository is used with external datasets.

Configuration

Architecture
CustomResearchModel
Context length (tokens)
256
Layers
6
Hidden size
128
Feed-forward size
512
Attention heads
4
Model type
transformer

Identity and Version

Repository
marcussari/reading-zero-shot-transfer
Publisher
Marcus S.
Task
Not stated by the source
Modality
Other
Library
Not stated by the source
Parameters
16,576 parameters
Languages
Not stated by the source
Revision
7727861c6bccdcdc553a977d8c177b7be77adf41
First published
2026-10-12
Last updated
2026-10-12

Files and Weights

6 files, 73.5 KB in total. The weights are 1 file totalling 66.8 KB in safetensors.

Weights1 file · 66.8 KB
Configuration2 files · 628 B
Documentation2 files · 4.6 KB
Repository1 file · 1.5 KB
Every file
FileTypeSizeSHA-256
model.safetensorsWeights66.8 KB 4ed61401de93
config.jsonConfiguration440 B —
training_args.jsonConfiguration188 B —
README.mdDocumentation1.4 KB —
summary.mdDocumentation3.1 KB —
.gitattributesRepository1.5 KB —

License and Download

License
mit
Access
Open weights, no gate
Download size
66.8 KB
Download from Marcus S.

Released by Marcus S. through its official repository on Hugging Face. Read the license.

Memory Requirements

PrecisionWeights in memory
As published66.8 KB
16-bit0.0 GB
8-bit0.0 GB
4-bit0.0 GB

Weights only, from the published parameter count; the key-value cache and runtime add to this.

Questions About reading-zero-shot-transfer

How much GPU memory does reading-zero-shot-transfer need?

About 0 GB at 16-bit and 0 GB at 4-bit: the weights (16,576 parameters) plus a working margin. A long context needs more.

What is the cheapest GPU to run reading-zero-shot-transfer on?

At 16-bit, 1x MI300X from $1.85 an hour; at 4-bit, 1x MI300X from $1.85 an hour, at the lowest on-demand prices the SAVRN Index lists.

Can I use reading-zero-shot-transfer commercially?

Yes. reading-zero-shot-transfer is released under MIT License. The MIT License is a short permissive license. It permits commercial use, modification and redistribution, provided the copyright notice and permission notice are included.

What is reading-zero-shot-transfer's context length?

256 tokens, from the maximum position embeddings in its published configuration.