Skip to page content
SAVRN
Search Plan a project

Open-weight model

mini-Jev

by Samat Zharassov samatv256/mini-Jev

mini-Jev is an open-weight model from Samat Zharassov, released under Apache License 2.0. It has 262,657 parameters. At 16-bit it needs about 0 GB of GPU memory, which fits on 1x MI300X from $1.85 an hour, at the lowest prices in the SAVRN Index. It draws 248 downloads a month.

mini-Jev is a 0.6B agentic decision model specialized for finite-choice tool and action selection. Give it a state, a question, and candidate actions; it returns a probability for each candidate.

Parameters262,657
Context—
Weights13.9 MB
Licenseapache-2.0
AccessOpen weights
Monthly Downloads248

Runs On

What it takes to serve mini-Jev (262,657 parameters): the memory its weights need at each precision, and the cheapest way to rent enough data-center GPUs to hold them.

PrecisionWeightsMemory neededCheapest setupPer hourAlso fits
16-bit 0.0 GB 0.0 GB 1x MI300X (192 GB)
Vultr
$1.85 1x H100 $1.99 · 1x MI325X $2.00
8-bit 0.0 GB 0.0 GB 1x MI300X (192 GB)
Vultr
$1.85 1x H100 $1.99 · 1x MI325X $2.00
4-bit 0.0 GB 0.0 GB 1x MI300X (192 GB)
Vultr
$1.85 1x H100 $1.99 · 1x MI325X $2.00

Memory is the weights at that precision plus 20% for the runtime and a short context; a long context needs more. Prices are the lowest on-demand hourly rates in the SAVRN Index, read Oct 18, 2026.

mini-Jev on every accelerator the SAVRN Index prices, at every precision

Model Card

By Samat Zharassov, published under apache-2.0, revision cfa671508bdf.

mini-Jev is a 0.6B agentic decision model specialized for finite-choice tool and action selection. Give it a state, a question, and candidate actions; it returns a probability for each candidate. It uses a Qwen3-0.6B backbone with an adapter and a compact decision head. Candidate scoring is permutation equivariant, and the model returns finite-choice probabilities rather than generated text or tool arguments. This is an early 10,626-update checkpoint. Training is planned through 50,000 updates; more training and broader decision supervision are coming. This interim release is not the final checkpoint. The current step-010626 checkpoint loads its adapter from adapter/, its decision-head…

Read Samat Zharassov's full model card

mini-Jev Qwen3-0.6B - step 10,626

mini-Jev is a 0.6B agentic decision model specialized for finite-choice tool and action selection. Give it a state, a question, and candidate actions; it returns a probability for each candidate. It uses a Qwen3-0.6B backbone with an adapter and a compact decision head. Candidate scoring is permutation equivariant, and the model returns finite-choice probabilities rather than generated text or tool arguments.

This is an early 10,626-update checkpoint. Training is planned through 50,000 updates; more training and broader decision supervision are coming. This interim release is not the final checkpoint.

Release files and revisions

The current step-010626 checkpoint loads its adapter from adapter/, its decision-head weights from decision_head.safetensors, and its inference loader from inference.py. Use these with config.json and the separately downloaded Qwen3-0.6B base model.

The retained root model.safetensors and odm_mini.py belong to the previous v1 baseline. They are preserved only for history and backward reference; they are not the step 10,626 weights or loader. To use that baseline, pin the previous revision.

Measured results

Evaluation Result Scope
BFCL V1 Multiple Function - Jev function-selection adaptation 96.5% (193/200) Selects the supplied function identity from 2-4 definitions. Not an official BFCL leaderboard score; does not generate arguments or execute calls.
Strict held-out Choice 65.6% (63/96) A selected, bucket-balanced validation slice, not the full validation split.
Bespoke OOD typed decisions 72.0% (36/50) Small synthetic sanity check with straightforward distractors; not a public benchmark.
LocalLLaMA/typed-decisions, full test set 34.0% (680/2,000) Choice 27.0%, Noul 52.2%, Score 25.6%. General typed decisions remain a weakness.

These evaluations have different datasets and denominators; their percentages are not directly comparable. The BFCL adaptation uses the BFCL V1 Multiple Function AST examples. The typed-decision result uses the LocalLLaMA/typed-decisions test split.

Intended use and limits

The current strength is finite-choice tool and action selection from state and supplied candidates. The model is less reliable for general typed decisions and for large candidate sets. It is not a general probability or classification model, and its probabilities have not been calibrated for arbitrary domains. A selected 17+ candidate held-out slice scored 4/17, so large sets need particular care.

Use

A CUDA GPU with BF16 support is required for this 4-bit package. Install the tested dependencies from requirements.txt. The Qwen3-0.6B base model is downloaded separately on first load; this repository contains only the adapter and decision head.

from inference import MiniJev

model = MiniJev.load(".")
result = model.predict(
    state={"user_goal": "Find tomorrow's weather forecast for Paris."},
    question="Given the current state and available options,\nwhich option should be selected?",
    question_type="choice",
    answer_options=[
        {"id": "weather", "type": "tool", "label": "get_weather_forecast",
         "description": "Look up the weather forecast for a place and date."},
        {"id": "invoice", "type": "tool", "label": "calculate_invoice_total",
         "description": "Add amounts on an invoice."},
        {"id": "email", "type": "tool", "label": "send_email",
         "description": "Send an email message."},
    ],
)
print(result["selected_id"])
print(result["options"])

Option IDs are bookkeeping and are excluded from model text. The model scores each supplied option and normalizes probabilities over the finite set. Input branches are limited to 8,192 tokens.

Data attribution

Decision supervision for this checkpoint draws in part on Jev Decisions v1, a public dataset released under CC BY 4.0. Its public upstream datasets carry their own attribution and licensing terms; see the dataset card and upstream license notes.

License

Apache-2.0. The Qwen3-0.6B base model is separately licensed by Qwen under Apache-2.0. See LICENSE and the base model card.

Identity and Version

Repository
samatv256/mini-Jev
Publisher
Samat Zharassov
Task
Not stated by the source
Modality
Other
Library
peft
Parameters
262,657 parameters
Languages
Not stated by the source
Revision
cfa671508bdfb2a65419bd7be536cf5cc793e047
First published
2026-09-21
Last updated
2026-09-29

Files and Weights

14 files, 14.0 MB in total. The weights are 3 files totalling 13.9 MB in safetensors.

Weights3 files · 13.9 MB
Configuration4 files · 28.0 KB
Documentation2 files · 16.8 KB
Other4 files · 10.5 KB
Repository1 file · 1.5 KB
Every file
FileTypeSizeSHA-256
adapter/adapter_model.safetensorsWeights5.3 MB 765e98743651
decision_head.safetensorsWeights7.6 MB f06d990297b2
model.safetensorsWeights1.1 MB 52b9cdd647ed
adapter/adapter_config.jsonConfiguration2.2 KB —
config.jsonConfiguration388 B —
inference.pyConfiguration12.3 KB —
odm_mini.pyConfiguration13.0 KB —
LICENSEDocumentation11.4 KB —
README.mdDocumentation5.4 KB —
assets/bfcl-by-candidates.svgOther4.3 KB —
assets/bfcl-step-comparison.svgOther2.6 KB —
assets/evaluation-summary.svgOther3.6 KB —
requirements.txtOther107 B —
.gitattributesRepository1.5 KB —

License and Download

License
apache-2.0
Access
Open weights, no gate
Download size
13.9 MB
Download from Samat Zharassov

Released by Samat Zharassov through its official repository on Hugging Face. Read the license.

Built From

Memory Requirements

PrecisionWeights in memory
As published13.9 MB
16-bit0.0 GB
8-bit0.0 GB
4-bit0.0 GB

Weights only, from the published parameter count; the key-value cache and runtime add to this.

Questions About mini-Jev

How much GPU memory does mini-Jev need?

About 0 GB at 16-bit and 0 GB at 4-bit: the weights (262,657 parameters) plus a working margin. A long context needs more.

What is the cheapest GPU to run mini-Jev on?

At 16-bit, 1x MI300X from $1.85 an hour; at 4-bit, 1x MI300X from $1.85 an hour, at the lowest on-demand prices the SAVRN Index lists.

Can I use mini-Jev commercially?

Yes. mini-Jev is released under Apache License 2.0. The Apache License 2.0 is a permissive open-source license. It permits commercial use, modification and redistribution. It requires keeping the license and copyright notices and any NOTICE file, stating significant changes, and it includes an express patent grant from contributors.