This model is a fine-tuned version of Itau-Unibanco/NorBERTo-base on an unknown dataset. It achieves the following results on the evaluation set: The following hyperparameters were used during training: - learningrate: 5e-05 - trainbatchsize: 2 - evalbatchsize: 4 - gradientaccumulationsteps: 16 - totaltrainbatchsize: 32 - lrschedulertype: linear - lrschedulerwarmupsteps: 500 - numepochs: 1.5 - mixedprecisiontraining: Native AMP - PEFT 0.20.0 - Transformers 5.16.1 - Pytorch 2.11.0+cu128 - Datasets 4.0.0 - Tokenizers 0.23.1