led-large-16384-BASE3ep-ASPRPreACE3ep · Model Card
led-large-16384-BASE3ep-ASPRPreACE3ep: Model Card
Written by Rosa Rodriguez-Sánchez, published under apache-2.0, revision 90f199862c6c, read 2026-09-29. Shown as written; SAVRN's own facts about this model are on its page.
This model is a fine-tuned version of rosadecsai/led-large-16384-BASE3ep on the None dataset. It achieves the following results on the evaluation set: - Loss: 2.0896 - Rouge1: 46.0449 - Rouge2: 15.3846 - Rougel: 20.0708 - Rougelsum: 44.1558 - Gen Len: 1.0
Model description
More information needed
Intended uses & limitations
More information needed
Training and evaluation data
More information needed
Training procedure
Training hyperparameters
The following hyperparameters were used during training: - learning_rate: 5e-05 - train_batch_size: 8 - eval_batch_size: 8 - seed: 42 - gradient_accumulation_steps: 2 - total_train_batch_size: 16 - optimizer: Use OptimizerNames.ADAMW_TORCH with betas=(0.9,0.999) and epsilon=1e-08 and optimizer_args=No additional optimizer arguments - lr_scheduler_type: linear - num_epochs: 3 - mixed_precision_training: Native AMP
Training results
| Training Loss | Epoch | Step | Validation Loss | Rouge1 | Rouge2 | Rougel | Rougelsum | Gen Len |
|---|---|---|---|---|---|---|---|---|
| 2.305 | 1.0 | 1132 | 2.0878 | 33.1015 | 12.5523 | 16.968 | 31.4325 | 1.0 |
| 2.3229 | 2.0 | 2264 | 2.0782 | 39.2573 | 16.2234 | 18.5676 | 38.1963 | 1.0 |
| 2.2209 | 2.9978 | 3393 | 2.0896 | 46.0449 | 15.3846 | 20.0708 | 44.1558 | 1.0 |
Framework versions
- Transformers 4.48.3
- Pytorch 2.11.0+cu128
- Datasets 4.8.5
- Tokenizers 0.21.4