Skip to page content
SAVRN
Search Plan a project

Open-weight model

dino-classification6

by Pedro pumarques/dino-classification6

dino-classification6 is an open-weight model from Pedro, released under Apache License 2.0. It has 24,832 parameters and a 128-token context. At 16-bit it needs about 0 GB of GPU memory, which fits on 1x MI300X from $1.85 an hour, at the lowest prices in the SAVRN Index.

A research-oriented Dino prototype targeting Classification. The included xlarge setup documents defaults and file formats without presenting unverified performance numbers. - The Python file contains the model and runnable example or training entry point.

Parameters24,832
Context128
Weights99.8 KB
Licenseapache-2.0
AccessOpen weights
Monthly Downloads—

Runs On

What it takes to serve dino-classification6 (24,832 parameters): the memory its weights need at each precision, and the cheapest way to rent enough data-center GPUs to hold them.

PrecisionWeightsMemory neededCheapest setupPer hourAlso fits
16-bit 0.0 GB 0.0 GB 1x MI300X (192 GB)
Vultr
$1.85 1x H100 $1.99 · 1x MI325X $2.00
8-bit 0.0 GB 0.0 GB 1x MI300X (192 GB)
Vultr
$1.85 1x H100 $1.99 · 1x MI325X $2.00
4-bit 0.0 GB 0.0 GB 1x MI300X (192 GB)
Vultr
$1.85 1x H100 $1.99 · 1x MI325X $2.00

Memory is the weights at that precision plus 20% for the runtime and a short context; a long context needs more. Prices are the lowest on-demand hourly rates in the SAVRN Index, read Oct 18, 2026.

dino-classification6 on every accelerator the SAVRN Index prices, at every precision

Model Card

By Pedro, published under apache-2.0, revision c6dddc92a4d7.

A research-oriented Dino prototype targeting Classification. The included xlarge setup documents defaults and file formats without presenting unverified performance numbers. - The Python file contains the model and runnable example or training entry point. - config.json records the generated architecture settings. - trainingargs.json records the default experiment recipe. - model.safetensors is a valid initialization checkpoint for smoke tests; it is not presented as a trained benchmark checkpoint. - No benchmark score is claimed in this repository. The included configuration uses adamw with a cosine schedule. These are starting values in the script, not evidence of a completed run. For a…

Read Pedro's full model card

Dino for Classification

Overview

A research-oriented Dino prototype targeting Classification. The included xlarge setup documents defaults and file formats without presenting unverified performance numbers.

Repository status

  • The Python file contains the model and runnable example or training entry point.
  • config.json records the generated architecture settings.
  • training_args.json records the default experiment recipe.
  • model.safetensors is a valid initialization checkpoint for smoke tests; it is not presented as a trained benchmark checkpoint.
  • No benchmark score is claimed in this repository.

Architecture

Item Value
Architecture Dino
Scale xlarge
Attention grouped query
Fusion low rank
Activation gelu tanh
Normalization instancenorm

Default experiment recipe

The included configuration uses adamw with a cosine schedule. These are starting values in the script, not evidence of a completed run. For a meaningful evaluation, train all baselines with the same data exposure, tuning budget, and random seeds.

Quick check

python inference.py --help

Inspect the script's __main__ block for its generated smoke-test example. Because this is a custom implementation, generic automatic loading APIs require an explicit adapter before use.

Evaluation guidance

A useful first evaluation would use a task-specific labeled split, report the task metric across at least three seeds, and include a matched-capacity baseline. Keep training logs and environment versions with any published result.

Limitations

The initialization checkpoint has not been trained or audited for robustness, fairness, or domain transfer. The implementation should be treated as an experimental starting point. Results from a future trained checkpoint must be documented separately from the defaults shipped here.

Files

  • inference.py — primary artifact
  • README.md — this documentation
  • config.json — architecture configuration
  • training_args.json — default experiment settings
  • model.safetensors — initialization checkpoint

License

Released under apache-2.0. Review the source-data terms separately when this repository is used with external datasets.

Configuration

Architecture
CustomResearchModel
Context length (tokens)
128
Layers
8
Hidden size
192
Feed-forward size
768
Attention heads
4
Model type
dino

Identity and Version

Repository
pumarques/dino-classification6
Publisher
Pedro
Task
Not stated by the source
Modality
Other
Library
Not stated by the source
Parameters
24,832 parameters
Languages
Not stated by the source
Revision
c6dddc92a4d736aa345b1e1788e6bfdc35cdb8a9
First published
2026-10-01
Last updated
2026-10-01

Files and Weights

6 files, 109.0 KB in total. The weights are 1 file totalling 99.8 KB in safetensors.

Weights1 file · 99.8 KB
Configuration3 files · 5.2 KB
Documentation1 file · 2.4 KB
Repository1 file · 1.5 KB
Every file
FileTypeSizeSHA-256
model.safetensorsWeights99.8 KB 1758a04d5fd5
config.jsonConfiguration431 B —
inference.pyConfiguration4.6 KB —
training_args.jsonConfiguration187 B —
README.mdDocumentation2.4 KB —
.gitattributesRepository1.5 KB —

License and Download

License
apache-2.0
Access
Open weights, no gate
Download size
99.8 KB
Download from Pedro

Released by Pedro through its official repository on Hugging Face. Read the license.

Memory Requirements

PrecisionWeights in memory
As published99.8 KB
16-bit0.0 GB
8-bit0.0 GB
4-bit0.0 GB

Weights only, from the published parameter count; the key-value cache and runtime add to this.

Questions About dino-classification6

How much GPU memory does dino-classification6 need?

About 0 GB at 16-bit and 0 GB at 4-bit: the weights (24,832 parameters) plus a working margin. A long context needs more.

What is the cheapest GPU to run dino-classification6 on?

At 16-bit, 1x MI300X from $1.85 an hour; at 4-bit, 1x MI300X from $1.85 an hour, at the lowest on-demand prices the SAVRN Index lists.

Can I use dino-classification6 commercially?

Yes. dino-classification6 is released under Apache License 2.0. The Apache License 2.0 is a permissive open-source license. It permits commercial use, modification and redistribution. It requires keeping the license and copyright notices and any NOTICE file, stating significant changes, and it includes an express patent grant from contributors.

What is dino-classification6's context length?

128 tokens, from the maximum position embeddings in its published configuration.