Checkpoint 3 of Harvard CS2881R Assignment 1: a Sheldon Cooper persona LoRA for Qwen/Qwen2.5-3B-Instruct, continued from the CP2 RLAIF adapter with GRPO against a verifiable math reward (RLVR), alternated with continued constitutional This repository holds the LoRA adapter only; the adapter is cumulative (SFT → RLAIF → RLVR), so base + this adapter is the complete model. None of these differences is statistically detectable. Against the RLAIF starting model, MATH-500 +1.8 pp (28 gained / 19 lost, McNemar p = 0.24), GSM8K +0.4 pp, and persona -0.003 (95% bootstrap CI -0.008 to +0.002). An independent Mistral-Small-24B-Instruct-2501 judge, on 100 held-out rows in both answer orders, found 1…
Independent publisher
Benedikt Koch
benjkoch
Models in Library1
Datasets in Library0
Models on Hugging Face2
Followers—
Compare the published evidence
This profile connects the 1 model and dataset record shown below to their upstream cards and sources. The library counts describe SAVRN's coverage, rather than this publisher's entire output.
Published tasks: Text generation.
Reported licenses: apache-2.0. Open a record to review its specific license and conditions.
Compare model specifications, source dates, and hardware estimates on the individual records. Publisher identity verification is separate from a model's quality, deployment readiness, or suitability for your work.