LoRA adapter only. This repo publishes the LoRA adapter (see adapter/ if present). The merged full model weights were removed; load the base model given in base_model and apply the adapter with PEFT.
Ministral-3-8B-Instruct-2512-matura-grpo-lora-closed-em
Ministral-3-8B-Instruct-2512 post-trained for the Polish history matura (extended level) during the Warsaw Model Trainers
Hackathon. Root: merged bf16 weights. adapter/: the LoRA adapter (r=32,
alpha=64) on top of mistralai/Ministral-3-8B-Instruct-2512-BF16 (the bf16 twin of the FP8 -2512 release).
- Method: GRPO (TRL, DAPO loss, G=8, beta=0) with an exact-match reward on closed exam items (
grpo_closed.jsonl), started from the base model (no SFT)
- Run:
grpo ministral8b lora r=32 lr=2e-5 G=8 grpo_closed (ClearML project HCKT/ministral-grpo, tag night-2026-09-26)
- Held out: every May 2017-2026 CKE paper and June 2020 were excluded from all training data.
System prompt (used in training; use it when serving)
Jesteś uczniem zdającym maturę z historii na poziomie rozszerzonym. Odpowiadaj po polsku, rzeczowo i dokładnie tak, jak wymaga polecenie oraz format odpowiedzi.
Validation (judge-free, greedy; eval_val.jsonl, 682 items: June 2026, Dec 2024 mock, synthetic val)
closed_em = exact match on closed items. Graded scores (deepseek-flash-high@think via benchmark/bench.py) are
reported separately.
| metric |
value |
| closed_em |
69.4 |
| n_closed |
317 |
| n_items |
682 |
| closed_em/cnt |
93.8 |
| closed_em/epod-generated |
72.6 |
| closed_em/epod-original |
56.5 |
| closed_em/reph |
50.0 |