This model is a fine-tuned version of distilbert/distilgpt2 on an unknown dataset. The following hyperparameters were used during training: - learningrate: 0.0005 - trainbatchsize: 32 - evalbatchsize: 32 - gradientaccumulationsteps: 8 - totaltrainbatchsize: 256 - lrschedulertype: cosine - lrschedulerwarmupsteps: 1000 - numepochs: 1 - mixedprecisiontraining: Native AMP - Transformers 4.57.1 - Pytorch 2.8.0+cu126 - Datasets 4.0.0 - Tokenizers 0.22.1
Independent publisher
Ai Xin
aixin2024
Models in Library1
Datasets in Library0
Models on Hugging Face16
Followers1
Compare the published evidence
This profile connects the 1 model and dataset record shown below to their upstream cards and sources. The library counts describe SAVRN's coverage, rather than this publisher's entire output.
Published tasks: Text generation.
Reported licenses: apache-2.0. Open a record to review its specific license and conditions.
Compare model specifications, source dates, and hardware estimates on the individual records. Publisher identity verification is separate from a model's quality, deployment readiness, or suitability for your work.