Run: phase1-online-rubrics-medicine-full-dense-20260919-seed11. The root contains a BF16 model for inference. originalcheckpoint/ contains the original veRL checkpoint files (model parameters only). The local checkpoint remains on disk. Research use only.
Open weights
apache-2.0
4B parameters
262,144 tokens
transformers
Run: phase1-online-rubrics-medicine-full-dense-20260919-seed11. The root contains a BF16 model for inference. originalcheckpoint/ contains the original veRL checkpoint files (model parameters only). The local checkpoint remains on disk. Research use only.
Open weights
apache-2.0
4B parameters
262,144 tokens
transformers
Open weights
Open weights
Run: phase1-static-r0-medicine-qwen3-4b-matched-dense-20260928-seed11. The root contains a BF16 model for inference. originalcheckpoint/ contains the original veRL checkpoint files (model parameters only). The local checkpoint remains on disk. Research use only.
Open weights
apache-2.0
4B parameters
262,144 tokens
transformers
Run: phase1-static-r0-medicine-qwen3-4b-matched-dense-20260928-seed11. The root contains a BF16 model for inference. originalcheckpoint/ contains the original veRL checkpoint files (model parameters only). The local checkpoint remains on disk. Research use only.
Open weights
apache-2.0
4B parameters
262,144 tokens
transformers
Run: phase1-static-r0-medicine-qwen3-4b-matched-dense-20260928-seed11. The root contains a BF16 model for inference. originalcheckpoint/ contains the original veRL checkpoint files (model parameters only). The local checkpoint remains on disk. Research use only.
Open weights
apache-2.0
4B parameters
262,144 tokens
transformers
Run: phase1-static-r0-medicine-qwen3-4b-matched-dense-20260928-seed11. The root contains a BF16 model for inference. originalcheckpoint/ contains the original veRL checkpoint files (model parameters only). The local checkpoint remains on disk. Research use only.
Open weights
apache-2.0
4B parameters
262,144 tokens
transformers
Run: phase1-static-r0-medicine-qwen3-4b-matched-dense-20260928-seed11. The root contains a BF16 model for inference. originalcheckpoint/ contains the original veRL checkpoint files (model parameters only). The local checkpoint remains on disk. Research use only.
Open weights
apache-2.0
4B parameters
262,144 tokens
transformers
Open weights
This is the policy after 0 global optimizer updates of the matched separate from the OnlineRubrics/dynamic-rubric checkpoints. The root files are a BF16 Transformers export for inference. The originalcheckpoint/ directory contains the exact original veRL/FSDP policy parameter checkpoint and its tokenizer/configuration files. Optimizer, trainer, and data-loader state are intentionally not published; the complete resume checkpoint remains on Daisy. This is an intermediate research checkpoint, not a clinical model. No medical capability or safety claim is made. Original actor parameter SHA256: f81409edc253a52ee9b3e6807bf280cf1ff242c77c2f6645b087c74e03a4e3d4
Open weights
apache-2.0
4B parameters
262,144 tokens
transformers
This is the policy after 3 global optimizer updates of the matched separate from the OnlineRubrics/dynamic-rubric checkpoints. The root files are a BF16 Transformers export for inference. The originalcheckpoint/ directory contains the exact original veRL/FSDP policy parameter checkpoint and its tokenizer/configuration files. Optimizer, trainer, and data-loader state are intentionally not published; the complete resume checkpoint remains on Daisy. This is an intermediate research checkpoint, not a clinical model. No medical capability or safety claim is made. Original actor parameter SHA256: 3339fe6d830916167c26f9e818cef25d0cecdbf3ab26e8545fcbcbf6465bfdc8
Open weights
apache-2.0
4B parameters
262,144 tokens
transformers
Open weights
This is the policy after 42 global optimizer updates of the matched separate from the OnlineRubrics/dynamic-rubric checkpoints. The root files are a BF16 Transformers export for inference. The originalcheckpoint/ directory contains the exact original veRL/FSDP policy parameter checkpoint and its tokenizer/configuration files. Optimizer, trainer, and data-loader state are intentionally not published; the complete resume checkpoint remains on Daisy. This is an intermediate research checkpoint, not a clinical model. No medical capability or safety claim is made. Original actor parameter SHA256: 3c024ab64a34d4140f446262e7fcee7fbd64da5b9de22cac486a986288e28063
Open weights
apache-2.0
4B parameters
262,144 tokens
transformers
LoRA adapters from a study of reward hacking in GRPO. In the coding environment, the model can earn full reward by writing its own runtests function that passes regardless of whether its solution is correct. Baseline runs learn to do this. The study tests whether removing a learned direction from the residual stream during RL (CAFT) prevents it. 1cfa9a7208912126459214e8b04321603b3df60c. - LoRA rank 32, alpha 32, on all attention and MLP projections. - Each folder holds adapterconfig.json and adaptermodel.safetensors. wave2/ -seed /step /: GRPO runs with 4 arms x 5 seeds, checkpoints at steps 100, 150 and 200 (200 steps, 16 prompts x 16 answers per step). The removal acts at block 19…
Open weights
apache-2.0
peft
Backups of two GRPO baseline runs on Qwen/Qwen3-4B (revision 1cfa9a7208912126459214e8b04321603b3df60c). Both use LoRA rank 32, seed 2, and 16 prompts × 16 answers per step. No direction is removed (a structural-zero hook at block 19). Both runs learned to hack the grader by weakening the tests: modify from about step 90, incontext from about step 120. Layout. backups/wave3loopholes/runs/ / holds every directory of each run. Runs that were continued after an interruption carry -resume... suffixes, and each step is taken from the newest directory that has it. A directory holds: - run configuration and build records; - LoRA adapters every 10 steps; - the full training state at steps 0, 100…
Open weights
Qwen3-4B-Instruct-2507 consolidated with OEL on the tau2-bench telecom domain, using 120 externally authored task–memory pairs from the revised finalpairs2 set, stratified down from 125 so the batches divide evenly. The student replays each task without memory; the teacher is the same weights with that task's memory in the system prompt. Only the prompt differs, and no reward is used. Five pairs were dropped from the 125 by stratified sampling (seed 42), holding the level ratios to within 1pp, so that no batch is short — earlier runs showed a tiny final batch wrecks the saved checkpoint, and only the last step is saved. Each step reads a different batch, so the loss column tracks batch…
Open weights
apache-2.0
4.4B parameters
262,144 tokens
This model was finetuned and converted to GGUF format using Unsloth. - qwen3-4b-thinking-2507.Q4KM.gguf An Ollama Modelfile is included for easy deployment. This was trained 2x faster with Unsloth
Open weights
262,144 tokens
A LoRA fine-tune of unsloth/Qwen3-4B that teaches the model when not to call a tool. On BFCL v4 Irrelevance Detection, under identical conditions and a full 240-entry category: The baselines are statistically indistinguishable from this adapter. v1 leads the 8B by 0.84 points and its own base by 1.67 — two and four test cases respectively. The public benchmark does not support the claim that this fine-tune materially improved abstention. The much larger margin in the self-scored eval below does not replicate. The same recipe with --seed 1337 scored 97.50% on irrelevance — 20 entries better than this adapter, and a headline a 4B beating an 8B. It was meaningless. On BFCL Multiple (AST)…
Open weights
apache-2.0
peft
Open weights
8.2B parameters
40,960 tokens
Base: Qwen/Qwen3-8B @ b968826d9c46dd6066d109eabc6255188de91218 (bf16, non-thinking chat template qwen3nothink.jinja from the experiment repo). Part of a multi-expert training + merging experiment on SWE-bench Pro v2-hard, HLE, ASI-Bench and Terminal-Bench 2.0. - mergedties/ - mopd/ - mergedlinearlora64/ - mergedlinear/ Recipes, data sources/licenses, evaluation protocol and results: see the experiment repository (models/README.md, data/README.md, configs/eval/benchmarks.yaml, results/summary.csv). Full-weight subfolders load with AutoModelForCausalLM.frompretrained("cokoro/qwen3-8b-moe-merge-merged", subfolder=" "). Limitations: experts were trained on small/proxy data (GSM8K for HLE…
Open weights
apache-2.0
transformers
Open weights
Qwen3-8B after full-parameter supervised fine-tuning for mathematical keyword and meaning generation. This is the exact saved epoch 4 checkpoint at optimizer step 2976. The repository contains the model weights, configuration, and tokenizer files for inference. Training dataset: devpotatopotato/math-keyword-training, keyword-261001-bigmath-gpt-6-sol.jsonl. Use the tokenizer chat template with enablethinking=False. Pass the following template as a user message and replace {problem} with the problem text
Open weights
apache-2.0
4.1B parameters
40,960 tokens
transformers
This model is a fine-tuned version of Qwen/Qwen3-8B on the skowshik1/gemma3-sft-agentclinic-style-diagnosis-shaped-v2 dataset. It has been trained using TRL. This model was trained with SFT.
Open weights
transformers