An OpenRLHF GRPO reinforcement-learning checkpoint for Qwen3-4B. - Saved at global step 16 of RL run seededrlbaseramp25stoppengen4kep2ncp10q4v3groot16. - This is the best checkpoint by pass@8 so far in this run (evaldefaultpass8 = 0.1244). Trained and validated on the cobalt-train ≤2/64 frontier (canonical cleaneval prompts): 1833 train / 112 held-out val problems the base model solved on at most 2 of 64 samples under the iidcanonical@64 hardness scan. Val evals sample at temperature 1.0 (matching the cleaneval frontier eval). Reward signal: binary code-correctness (1.0 if the generated program passes the problem's tests, otherwise 0.0). Eval metrics at this checkpoint (held-out val, 8…
Open weights
4.4B parameters
262,144 tokens
transformers
An OpenRLHF GRPO reinforcement-learning checkpoint for Qwen3-4B. - Saved at global step 60 of RL run seededrlbaseramp25stoppengen4kep2ncp5q4v3groot16. - This is the best checkpoint by pass@8 so far in this run. Trained and validated on the cobalt-train ≤2/64 frontier (canonical cleaneval prompts): 1833 train / 112 held-out val problems the base model solved on at most 2 of 64 samples under the iidcanonical@64 hardness scan. Val evals sample at temperature 1.0 (matching the cleaneval frontier eval). Reward signal: binary code-correctness (1.0 if the generated program passes the problem's tests, otherwise 0.0). This checkpoint is the main revision (git branch) of the repo, with the model at…
Open weights
4.4B parameters
262,144 tokens
transformers
An OpenRLHF GRPO reinforcement-learning checkpoint for Qwen3-4B. - Saved at global step 56 of RL run seededrlbaseramp25stoppengen4kep2ncp5q4v3iid16. - This is the best checkpoint by pass@8 so far in this run. Trained and validated on the cobalt-train ≤2/64 frontier (canonical cleaneval prompts): 1833 train / 112 held-out val problems the base model solved on at most 2 of 64 samples under the iidcanonical@64 hardness scan. Val evals sample at temperature 1.0 (matching the cleaneval frontier eval). Reward signal: binary code-correctness (1.0 if the generated program passes the problem's tests, otherwise 0.0). This checkpoint is the main revision (git branch) of the repo, with the model at the…
Open weights
4.4B parameters
262,144 tokens
transformers
An OpenRLHF GRPO reinforcement-learning checkpoint for Qwen3-4B. - Saved at global step 40 of RL run seededrlbaseramp25stoppengen4kep2ncp10baseq4v3. - This is the best checkpoint by pass@8 so far in this run (evaldefaultpass8 = 0.0421). Trained and validated on the cobalt-train ≤2/64 frontier (canonical cleaneval prompts): 1833 train / 112 held-out val problems the base model solved on at most 2 of 64 samples under the iidcanonical@64 hardness scan. Val evals sample at temperature 1.0 (matching the cleaneval frontier eval). Reward signal: binary code-correctness (1.0 if the generated program passes the problem's tests, otherwise 0.0). Eval metrics at this checkpoint (held-out val, 8…
Open weights
4.4B parameters
262,144 tokens
transformers
An OpenRLHF GRPO reinforcement-learning checkpoint for Qwen3-4B. - Saved at global step 56 of RL run seededrlbaseramp25stoppengen4kep2ncp5q3cgroot16. - This is the best checkpoint by pass@8 so far in this run. Trained and validated on the cobalt-train ≤2/64 frontier (canonical cleaneval prompts): 1833 train / 112 held-out val problems the base model solved on at most 2 of 64 samples under the iidcanonical@64 hardness scan. Val evals sample at temperature 1.0 (matching the cleaneval frontier eval). Reward signal: binary code-correctness (1.0 if the generated program passes the problem's tests, otherwise 0.0). This checkpoint is the main revision (git branch) of the repo, with the model at…
Open weights
4.4B parameters
262,144 tokens
transformers
An OpenRLHF GRPO reinforcement-learning checkpoint for Qwen3-4B. - Saved at global step 66 of RL run seededrlbaseramp25stoppengen4kep2ncp5baseq3c. - This is the best checkpoint by pass@8 so far in this run. Trained and validated on the cobalt-train ≤2/64 frontier (canonical cleaneval prompts): 1833 train / 112 held-out val problems the base model solved on at most 2 of 64 samples under the iidcanonical@64 hardness scan. Val evals sample at temperature 1.0 (matching the cleaneval frontier eval). Reward signal: binary code-correctness (1.0 if the generated program passes the problem's tests, otherwise 0.0). This checkpoint is the main revision (git branch) of the repo, with the model at the…
Open weights
4.4B parameters
262,144 tokens
transformers