SAVRN
Search Contact SAVRN

Independent publisher

Oriane Peter

orpe42

Models in Library1
Datasets in Library0
Models on Hugging Face3
Followers

Models

This model is a fine-tuned version of on an unknown dataset. The following hyperparameters were used during training: - learningrate: 1e-05 - trainbatchsize: 2 - evalbatchsize: 4 - gradientaccumulationsteps: 4 - totaltrainbatchsize: 8 - lrschedulertype: cosine - lrschedulerwarmupsteps: 0.1 - numepochs: 50 - Transformers 5.12.1 - Pytorch 2.5.1+cu121 - Datasets 5.0.1 - Tokenizers 0.22.2

Open weights 434M parameters 512 tokens transformers