Three LoRA adapters trained jointly in Stage 1 of the CoTMTKD pipeline. Each adapter is one "expert" on top of Qwen/Qwen2.5-7B-Instruct; the experts are trained with an SFT loss plus a DPP repulsion term that pushes them apart. They are meant to be used as teachers for the Stage 2 distillation step of that pipeline. The pipeline's own final/adapterstates.pt bundle and the resumable checkpoint.pt referenced in manifest.json are not uploaded. Absolute local paths in config.yaml and manifest.json were rewritten as relative paths, so the configfilesha256 in the manifest no longer matches config.yaml. - 3 epochs, 94 optimizer steps, global batch size 32, learning rate 5e-5, AdamW, cosine…
Independent publisher
Truong Linh Duyen
duyentl04
Models in Library1
Datasets in Library0
Models on Hugging Face1
Followers—
Compare the published evidence
This profile connects the 1 model and dataset record shown below to their upstream cards and sources. The library counts describe SAVRN's coverage, rather than this publisher's entire output.
Published tasks: Text generation.
Compare model specifications, source dates, and hardware estimates on the individual records. Publisher identity verification is separate from a model's quality, deployment readiness, or suitability for your work.