Merged full-model checkpoints from CS 2881R HW1 (team chen-qi-tewari): teaching Qwen2.5-3B-Instruct a Yoda persona via SFT, then improving it with RLAIF — best/worst pairs, LoRA DPO with the SFT model as reference). Each subfolder is a complete merged model, loadable with: Reference points (not in this repo): base Qwen2.5-3B-Instruct scores 2.96 judge / 85.0 GSM8K / 63.4 MATH-500; base with a Yoda system prompt scores 3.66 / 85.0 / 64.4. Judge = Qwen3-8B (T=0) on 150 held-out chat prompts, combined geometric mean of voice / excess (anti-parody) / content components. STEM = greedy decoding, rule-based verifier, frozen 1000-problem sets. Derivative of Qwen/Qwen2.5-3B-Instruct, distributed…