mini-Jev is an open-weight model from Samat Zharassov, released under Apache License 2.0. It has 262,657 parameters. At 16-bit it needs about 0 GB of GPU memory, which fits on 1x MI300X from $1.85 an hour, at the lowest prices in the SAVRN Index. It draws 248 downloads a month.
mini-Jev is a 0.6B agentic decision model specialized for finite-choice tool and action selection. Give it a state, a question, and candidate actions; it returns a probability for each candidate.
Runs On
What it takes to serve mini-Jev (262,657 parameters): the memory its weights need at each precision, and the cheapest way to rent enough data-center GPUs to hold them.
| Precision | Weights | Memory needed | Cheapest setup | Per hour | Also fits |
|---|---|---|---|---|---|
| 16-bit | 0.0 GB | 0.0 GB | 1x MI300X (192 GB) Vultr |
$1.85 | 1x H100 $1.99 · 1x MI325X $2.00 |
| 8-bit | 0.0 GB | 0.0 GB | 1x MI300X (192 GB) Vultr |
$1.85 | 1x H100 $1.99 · 1x MI325X $2.00 |
| 4-bit | 0.0 GB | 0.0 GB | 1x MI300X (192 GB) Vultr |
$1.85 | 1x H100 $1.99 · 1x MI325X $2.00 |
Memory is the weights at that precision plus 20% for the runtime and a short context; a long context needs more. Prices are the lowest on-demand hourly rates in the SAVRN Index, read Oct 18, 2026.
mini-Jev on every accelerator the SAVRN Index prices, at every precision
Model Card
By Samat Zharassov, published under apache-2.0, revision cfa671508bdf.
mini-Jev is a 0.6B agentic decision model specialized for finite-choice tool and action selection. Give it a state, a question, and candidate actions; it returns a probability for each candidate. It uses a Qwen3-0.6B backbone with an adapter and a compact decision head. Candidate scoring is permutation equivariant, and the model returns finite-choice probabilities rather than generated text or tool arguments. This is an early 10,626-update checkpoint. Training is planned through 50,000 updates; more training and broader decision supervision are coming. This interim release is not the final checkpoint. The current step-010626 checkpoint loads its adapter from adapter/, its decision-head…
Read Samat Zharassov's full model card
mini-Jev Qwen3-0.6B - step 10,626
mini-Jev is a 0.6B agentic decision model specialized for finite-choice tool and action selection. Give it a state, a question, and candidate actions; it returns a probability for each candidate. It uses a Qwen3-0.6B backbone with an adapter and a compact decision head. Candidate scoring is permutation equivariant, and the model returns finite-choice probabilities rather than generated text or tool arguments.
This is an early 10,626-update checkpoint. Training is planned through 50,000 updates; more training and broader decision supervision are coming. This interim release is not the final checkpoint.
Release files and revisions
The current step-010626 checkpoint loads its adapter from adapter/, its decision-head weights from decision_head.safetensors, and its inference loader from inference.py. Use these with config.json and the separately downloaded Qwen3-0.6B base model.
The retained root model.safetensors and odm_mini.py belong to the previous v1 baseline. They are preserved only for history and backward reference; they are not the step 10,626 weights or loader. To use that baseline, pin the previous revision.
Measured results
| Evaluation | Result | Scope |
|---|---|---|
| BFCL V1 Multiple Function - Jev function-selection adaptation | 96.5% (193/200) | Selects the supplied function identity from 2-4 definitions. Not an official BFCL leaderboard score; does not generate arguments or execute calls. |
| Strict held-out Choice | 65.6% (63/96) | A selected, bucket-balanced validation slice, not the full validation split. |
| Bespoke OOD typed decisions | 72.0% (36/50) | Small synthetic sanity check with straightforward distractors; not a public benchmark. |
| LocalLLaMA/typed-decisions, full test set | 34.0% (680/2,000) | Choice 27.0%, Noul 52.2%, Score 25.6%. General typed decisions remain a weakness. |
These evaluations have different datasets and denominators; their percentages are not directly comparable. The BFCL adaptation uses the BFCL V1 Multiple Function AST examples. The typed-decision result uses the LocalLLaMA/typed-decisions test split.
Intended use and limits
The current strength is finite-choice tool and action selection from state and supplied candidates. The model is less reliable for general typed decisions and for large candidate sets. It is not a general probability or classification model, and its probabilities have not been calibrated for arbitrary domains. A selected 17+ candidate held-out slice scored 4/17, so large sets need particular care.
Use
A CUDA GPU with BF16 support is required for this 4-bit package. Install the tested dependencies from requirements.txt. The Qwen3-0.6B base model is downloaded separately on first load; this repository contains only the adapter and decision head.
from inference import MiniJev
model = MiniJev.load(".")
result = model.predict(
state={"user_goal": "Find tomorrow's weather forecast for Paris."},
question="Given the current state and available options,\nwhich option should be selected?",
question_type="choice",
answer_options=[
{"id": "weather", "type": "tool", "label": "get_weather_forecast",
"description": "Look up the weather forecast for a place and date."},
{"id": "invoice", "type": "tool", "label": "calculate_invoice_total",
"description": "Add amounts on an invoice."},
{"id": "email", "type": "tool", "label": "send_email",
"description": "Send an email message."},
],
)
print(result["selected_id"])
print(result["options"])
Option IDs are bookkeeping and are excluded from model text. The model scores each supplied option and normalizes probabilities over the finite set. Input branches are limited to 8,192 tokens.
Data attribution
Decision supervision for this checkpoint draws in part on Jev Decisions v1, a public dataset released under CC BY 4.0. Its public upstream datasets carry their own attribution and licensing terms; see the dataset card and upstream license notes.
License
Apache-2.0. The Qwen3-0.6B base model is separately licensed by Qwen under Apache-2.0. See LICENSE and the base model card.
Identity and Version
- Repository
- samatv256/mini-Jev
- Publisher
- Samat Zharassov
- Task
- Not stated by the source
- Modality
- Other
- Library
- peft
- Parameters
- 262,657 parameters
- Languages
- Not stated by the source
- Revision
- cfa671508bdfb2a65419bd7be536cf5cc793e047
- First published
- 2026-09-21
- Last updated
- 2026-09-29
Files and Weights
14 files, 14.0 MB in total. The weights are 3 files totalling 13.9 MB in safetensors.
Every file
| File | Type | Size | SHA-256 |
|---|---|---|---|
| adapter/adapter_model.safetensors | Weights | 5.3 MB | 765e98743651 |
| decision_head.safetensors | Weights | 7.6 MB | f06d990297b2 |
| model.safetensors | Weights | 1.1 MB | 52b9cdd647ed |
| adapter/adapter_config.json | Configuration | 2.2 KB | — |
| config.json | Configuration | 388 B | — |
| inference.py | Configuration | 12.3 KB | — |
| odm_mini.py | Configuration | 13.0 KB | — |
| LICENSE | Documentation | 11.4 KB | — |
| README.md | Documentation | 5.4 KB | — |
| assets/bfcl-by-candidates.svg | Other | 4.3 KB | — |
| assets/bfcl-step-comparison.svg | Other | 2.6 KB | — |
| assets/evaluation-summary.svg | Other | 3.6 KB | — |
| requirements.txt | Other | 107 B | — |
| .gitattributes | Repository | 1.5 KB | — |
License and Download
- License
- apache-2.0
- Access
- Open weights, no gate
- Download size
- 13.9 MB
Released by Samat Zharassov through its official repository on Hugging Face. Read the license.
Built From
- Adapter of Qwen/Qwen3-0.6B
- Derived from Qwen/Qwen3-0.6B
Memory Requirements
| Precision | Weights in memory |
|---|---|
| As published | 13.9 MB |
| 16-bit | 0.0 GB |
| 8-bit | 0.0 GB |
| 4-bit | 0.0 GB |
Weights only, from the published parameter count; the key-value cache and runtime add to this.
Questions About mini-Jev
How much GPU memory does mini-Jev need?
About 0 GB at 16-bit and 0 GB at 4-bit: the weights (262,657 parameters) plus a working margin. A long context needs more.
What is the cheapest GPU to run mini-Jev on?
At 16-bit, 1x MI300X from $1.85 an hour; at 4-bit, 1x MI300X from $1.85 an hour, at the lowest on-demand prices the SAVRN Index lists.
Can I use mini-Jev commercially?
Yes. mini-Jev is released under Apache License 2.0. The Apache License 2.0 is a permissive open-source license. It permits commercial use, modification and redistribution. It requires keeping the license and copyright notices and any NOTICE file, stating significant changes, and it includes an express patent grant from contributors.