LoRA adapters from a research sprint asking whether safety transfers subliminally through distillation. Report and code: https://github.com/Realmbird/distilling-safety (see reports/REPORT.md). Research artifacts, not for deployment. Several students are measurably less safe than the base model (that is the main finding); none of these adapters should be used as a safety intervention. All adapters sit on Qwen/Qwen2.5-7B-Instruct ("M0"). Teacher recipe: LoRA r=64, alpha=64, all attention and MLP projections; lr 1e-4, cosine schedule, 1 epoch, batch 16, max length 1024; completion-only loss. Data: LLM-LAT/harmful-dataset (2.5k-prompt training split) and LLM-LAT/benign-dataset (2.5k rows)…
Independent publisher
Christopher Kinoshita
Realmbird
Models in Library1
Datasets in Library0
Models on Hugging Face31
Followers—
Compare the published evidence
This profile connects the 1 model and dataset record shown below to their upstream cards and sources. The library counts describe SAVRN's coverage, rather than this publisher's entire output.
Reported licenses: apache-2.0. Open a record to review its specific license and conditions.
Compare model specifications, source dates, and hardware estimates on the individual records. Publisher identity verification is separate from a model's quality, deployment readiness, or suitability for your work.