A post-training study: teach a 3B model to talk like Gandalf (voice derived from the film transcripts) without losing GSM8K accuracy. Every adapter here is LoRA r=32 on all seven projections of every layer, bf16. All were evaluated on the same 200 GSM8K test questions (rule-based verifier, greedy) and 60 held-out open prompts (voice 1 to 5 from an LLM judge). The prompted base model scores 0.855 accuracy, 1.0 voice. Best checkpoint: 010/tower-dpo, the voice tower after DPO (restatement accuracy 0.870, faithful 0.77, voice on math 4.36). Best single model: 004/D320-rlvr (accuracy 0.885, voice 3.67). System prompt used in training and evaluation: the Gandalf persona prompt built from…
Independent publisher
Henry Tan
henryatharvard
Models in Library1
Datasets in Library0
Models on Hugging Face1
Followers—
Compare the published evidence
This profile connects the 1 model and dataset record shown below to their upstream cards and sources. The library counts describe SAVRN's coverage, rather than this publisher's entire output.
Compare model specifications, source dates, and hardware estimates on the individual records. Publisher identity verification is separate from a model's quality, deployment readiness, or suitability for your work.