Skip to page content
SAVRN
Search Plan a project

Open-weight model · Image feature extraction

keural-vision-encoder-mid

by Hika Dalju Hikaf143/keural-vision-encoder-mid

keural-vision-encoder-mid is an open-weight model for image feature extraction from Hika Dalju, released under other. It has 184M parameters. At 16-bit it needs about 0.4 GB of GPU memory, which fits on 1x MI300X from $1.85 an hour, at the lowest prices in the SAVRN Index.

A 183.5M-parameter image encoder built from scratch — adaptive tokenization, hierarchical concept tokens, and continuous 2D positional encoding. Not a CLIP/ViT fine-tune. Measured at 384×384 with tokenbudget=512, matching training.

Parameters184M
Context—
Weights8.2 GB
Licenseother
AccessOpen weights
Monthly Downloads—

Runs On

What it takes to serve keural-vision-encoder-mid (184M parameters): the memory its weights need at each precision, and the cheapest way to rent enough data-center GPUs to hold them.

PrecisionWeightsMemory neededCheapest setupPer hourAlso fits
16-bit 0.4 GB 0.4 GB 1x MI300X (192 GB)
Vultr
$1.85 1x H100 $1.99 · 1x MI325X $2.00
8-bit 0.2 GB 0.2 GB 1x MI300X (192 GB)
Vultr
$1.85 1x H100 $1.99 · 1x MI325X $2.00
4-bit 0.1 GB 0.1 GB 1x MI300X (192 GB)
Vultr
$1.85 1x H100 $1.99 · 1x MI325X $2.00

Memory is the weights at that precision plus 20% for the runtime and a short context; a long context needs more. Prices are the lowest on-demand hourly rates in the SAVRN Index, read Oct 19, 2026.

keural-vision-encoder-mid on every accelerator the SAVRN Index prices, at every precision

Model Card

A 183.5M-parameter image encoder built from scratch — adaptive tokenization, hierarchical concept tokens, and continuous 2D positional encoding. Not a CLIP/ViT fine-tune. Measured at 384×384 with tokenbudget=512, matching training. Accuracy trails same-size peers — see Limitations and Evaluation for why, and for the higher-k retrieval results where the gap closes. The encoder is frozen and used as-is inside a bilingual (English + Korean) Only a projector (8.9M) and LoRA adapters (5.0M) are trained on top; the decoder is Qwen2.5-7B-Instruct. A vision-language model can score respectably while barely using the image, because many questions are answerable from language priors alone. Each…

Excerpt from the card by Hika Dalju, licensed other.

Configuration

Architecture
KeuralVisionModel
Model type
keural_vision

Identity and Version

Repository
Hikaf143/keural-vision-encoder-mid
Publisher
Hika Dalju
Task
Image feature extraction
Modality
Other
Library
transformers
Parameters
184M parameters
Languages
en
Revision
2a9a19ca52e69bb3999667b7b133e36c103454fc
First published
2026-10-12
Last updated
2026-10-12

Files and Weights

29 files, 8.2 GB in total. The weights are 11 files totalling 8.2 GB in pt, safetensors.

Weights11 files · 8.2 GB
Configuration8 files · 16.3 KB
Documentation1 file · 16.9 KB
Other8 files · 5.0 MB
Repository1 file · 2.2 KB
Every file
FileTypeSizeSHA-256
alignment_state.ptWeights9.1 MB 10c8ef42816f
checkpoint-10000/model.safetensorsWeights734.3 MB 1a9de63c772a
checkpoint-10000/training_state.ptWeights1.5 GB aa3bf0d4507e
checkpoint-15000/alignment_state.ptWeights9.1 MB 39450b6d5f93
checkpoint-15000/model.safetensorsWeights734.3 MB cc636995d6aa
checkpoint-15000/training_state.ptWeights1.5 GB 71d58899aa3f
checkpoint-18000/alignment_state.ptWeights9.1 MB 10c8ef42816f
checkpoint-18000/model.safetensorsWeights734.3 MB 93ccb1eb1365
checkpoint-9000/model.safetensorsWeights734.3 MB 879f1701b490
checkpoint-9000/training_state.ptWeights1.5 GB 139f29da5cac
model.safetensorsWeights734.3 MB 93ccb1eb1365
checkpoint-10000/config.jsonConfiguration3.1 KB —
checkpoint-15000/config.jsonConfiguration3.0 KB —
checkpoint-18000/config.jsonConfiguration3.0 KB —
checkpoint-18000/eval_results.jsonConfiguration357 B —
checkpoint-18000/eval_results_budget512.jsonConfiguration379 B —
checkpoint-18000/eval_results_budget576.jsonConfiguration380 B —
checkpoint-9000/config.jsonConfiguration3.1 KB —
config.jsonConfiguration3.0 KB —
README.mdDocumentation16.9 KB —
benchmark_comparison_chart.pngOther272.6 KB 521a525e1a2a
benchmark_radar_chart.pngOther373.7 KB 9c915550422b
benchmark_recall_at10_chart.pngOther227.3 KB 7c3fc9f3d5da
benchmark_recall_at5_chart.pngOther226.3 KB 821f653da750
benchmark_recall_curve_chart.pngOther253.7 KB 3bf31e0cd78d
keural_mid_architecture.pngOther1.1 MB 42a1c75bb2ab
saliency_evolution_9ckpt.pngOther2.2 MB dc6b4b2807ed
training_loss_curves.pngOther277.0 KB 9dd413f2eb5f
.gitattributesRepository2.2 KB —

License and Download

License
other
Access
Open weights, no gate
Download size
8.2 GB
Download from Hika Dalju

Released by Hika Dalju through its official repository on Hugging Face.

Evaluations

Each result is shown as reported, with the conditions its reporter stated. None is a SAVRN measurement. A comparison lines two results up only when their configuration, unit and setup are all stated and identical.

BenchmarkConditionsResultReported byRevisionDate
CIFAR-100 Task Linear ProbeMetric Linear probe Top-1Comparison conditions not established 75 Hikaf143
Publisher reported
Evaluated revision not stated —
Flickr30K Task Image-to-Text RetrievalMetric Image-to-Text R@1Comparison conditions not established 42.9 Hikaf143
Publisher reported
Evaluated revision not stated —
Flickr30K Task Image-to-Text RetrievalMetric Image-to-Text R@10Comparison conditions not established 80.6 Hikaf143
Publisher reported
Evaluated revision not stated —
Flickr30K Task Image-to-Text RetrievalMetric Text-to-Image R@1Comparison conditions not established 42.2 Hikaf143
Publisher reported
Evaluated revision not stated —
Flickr30K Task Image-to-Text RetrievalMetric Text-to-Image R@10Comparison conditions not established 79.4 Hikaf143
Publisher reported
Evaluated revision not stated —
ImageNet-1k (validation) Task Zero-Shot Image ClassificationMetric Top-1 accuracyComparison conditions not established 37.2 Hikaf143
Publisher reported
Evaluated revision not stated —
ImageNet-1k (validation) Task Zero-Shot Image ClassificationMetric Top-5 accuracyComparison conditions not established 66.8 Hikaf143
Publisher reported
Evaluated revision not stated —

Memory Requirements

PrecisionWeights in memory
As published8.2 GB
16-bit0.4 GB
8-bit0.2 GB
4-bit0.1 GB

Weights only, from the published parameter count; the key-value cache and runtime add to this.

Questions About keural-vision-encoder-mid

How much GPU memory does keural-vision-encoder-mid need?

About 0.4 GB at 16-bit and 0.1 GB at 4-bit: the weights (184M parameters) plus a working margin. A long context needs more.

What is the cheapest GPU to run keural-vision-encoder-mid on?

At 16-bit, 1x MI300X from $1.85 an hour; at 4-bit, 1x MI300X from $1.85 an hour, at the lowest on-demand prices the SAVRN Index lists.

What license is keural-vision-encoder-mid released under?

other, as its publisher declares it. Read the license text before commercial use.

Similar Models

Model · Image feature extraction

dinov2-base

AI at Meta

Vision Transformer (ViT) model trained using the DINOv2 method. It was introduced in the paper DINOv2: Learning Robust Visual Features without Supervision by Oquab et al. and first released in this repository. Disclaimer: The team releasing DINOv2 did not write a model card for this model so this model card has been written by the Hugging Face team. The Vision Transformer (ViT) is a transformer encoder model (BERT-like) pretrained on a large collection of images in a self-supervised fashion. Images are presented to the model as a sequence of fixed-size patches, which are linearly embedded. One also adds a [CLS] token to the beginning of a sequence to use it for classification tasks. One…

Open weights apache-2.0 87M parameters transformers

Model · Image feature extraction

vit-base-patch16-224-in21k

Google

Vision Transformer (ViT) model pre-trained on ImageNet-21k (14 million images, 21,843 classes) at resolution 224x224. It was introduced in the paper An Image is Worth 16x16 Words: Transformers for Image Recognition at Scale by Dosovitskiy et al. and first released in this repository. However, the weights were converted from the timm repository by Ross Wightman, who already converted the weights from JAX to PyTorch. Credits go to him. Disclaimer: The team releasing ViT did not write a model card for this model so this model card has been written by the Hugging Face team. The Vision Transformer (ViT) is a transformer encoder model (BERT-like) pretrained on a large collection of images in a…

Open weights apache-2.0 86M parameters transformers

Model · Image feature extraction

dinov3-vitl16-pretrain-lvd1689m

Camenduru

DINOv3 is a family of versatile vision foundation models that outperforms the specialized state of the art across a broad range of settings, without fine-tuning. DINOv3 produces high-quality dense features that achieve outstanding performance on various vision tasks, significantly surpassing previous self- and weakly-supervised foundation models. These are Vision Transformer and ConvNeXt models trained following the method described in the DINOv3 paper. 12 models are provided: - 10 models pretrained on web data (LVD-1689M dataset) - 1 ViT-7B trained from scratch, - 5 ViT-S/S+/B/L/H+ models distilled from the ViT-7B, - 4 ConvNeXt-{T/S/B/L} models distilled from the ViT-7B, - 2 models…

Open weights other 303M parameters transformers

Model · Image feature extraction

dinov2-large

AI at Meta

Vision Transformer (ViT) model trained using the DINOv2 method. It was introduced in the paper DINOv2: Learning Robust Visual Features without Supervision by Oquab et al. and first released in this repository. Disclaimer: The team releasing DINOv2 did not write a model card for this model so this model card has been written by the Hugging Face team. The Vision Transformer (ViT) is a transformer encoder model (BERT-like) pretrained on a large collection of images in a self-supervised fashion. Images are presented to the model as a sequence of fixed-size patches, which are linearly embedded. One also adds a [CLS] token to the beginning of a sequence to use it for classification tasks. One…

Open weights apache-2.0 304M parameters transformers

Model · Image feature extraction

dinov2-small

AI at Meta

Vision Transformer (ViT) model trained using the DINOv2 method. It was introduced in the paper DINOv2: Learning Robust Visual Features without Supervision by Oquab et al. and first released in this repository. Disclaimer: The team releasing DINOv2 did not write a model card for this model so this model card has been written by the Hugging Face team. The Vision Transformer (ViT) is a transformer encoder model (BERT-like) pretrained on a large collection of images in a self-supervised fashion. Images are presented to the model as a sequence of fixed-size patches, which are linearly embedded. One also adds a [CLS] token to the beginning of a sequence to use it for classification tasks. One…

Open weights apache-2.0 22M parameters transformers

Model · Image feature extraction

vit_small_patch14_dinov2.lvd142m

PyTorch Image Models

A Vision Transformer (ViT) image feature model. Pretrained on LVD-142M with self-supervised DINOv2 method. - An Image is Worth 16x16 Words: Transformers for Image Recognition at Scale: https://arxiv.org/abs/2010.11929v2 Explore the dataset and runtime metrics of this model in timm model results.

Open weights apache-2.0 22M parameters timm