This model is a fine-tuned version of qing-yao/ppt-pythia-160m-uniform250-previousmse-seed324-stage1 on the None dataset. It achieves the following results on the evaluation set: The following hyperparameters were used during training: - learningrate: 0.001 - trainbatchsize: 16 - evalbatchsize: 16 - gradientaccumulationsteps: 2 - totaltrainbatchsize: 32 - lrschedulertype: cosinewithminlr - lrschedulerwarmupsteps: 500 - trainingsteps: 10000 - Transformers 5.4.0 - Pytorch 2.8.0+cu128 - Datasets 3.2.0 - Tokenizers 0.22.1
Open weights
apache-2.0
162M parameters
2,048 tokens
transformers
Open weights
162M parameters
2,048 tokens
This model is a fine-tuned version of qing-yao/ppt-pythia-160m-uniform250-previousmse-seed324-stage1 on the None dataset. It achieves the following results on the evaluation set: The following hyperparameters were used during training: - learningrate: 0.001 - trainbatchsize: 16 - evalbatchsize: 16 - gradientaccumulationsteps: 2 - totaltrainbatchsize: 32 - lrschedulertype: cosinewithminlr - lrschedulerwarmupsteps: 500 - trainingsteps: 10000 - Transformers 5.4.0 - Pytorch 2.8.0+cu128 - Datasets 3.2.0 - Tokenizers 0.22.1
Open weights
apache-2.0
162M parameters
2,048 tokens
transformers
Open weights
162M parameters
2,048 tokens
Open weights
162M parameters
2,048 tokens
This model is a fine-tuned version of EleutherAI/pythia-1b. It has been trained using TRL. This model was trained with SFT.
Open weights
1B parameters
2,048 tokens
transformers
This model is a fine-tuned version of EleutherAI/pythia-1b. It has been trained using TRL. This model was trained with SFT.
Open weights
1B parameters
2,048 tokens
transformers
This model is a fine-tuned version of EleutherAI/pythia-1b. It has been trained using TRL. This model was trained with SFT.
Open weights
1B parameters
2,048 tokens
transformers
This model is a fine-tuned version of EleutherAI/pythia-1b. It has been trained using TRL. This model was trained with SFT.
Open weights
1B parameters
2,048 tokens
transformers
This model is a fine-tuned version of EleutherAI/pythia-1b. It has been trained using TRL. This model was trained with SFT.
Open weights
1B parameters
2,048 tokens
transformers
This model is a fine-tuned version of EleutherAI/pythia-1b. It has been trained using TRL. This model was trained with SFT.
Open weights
1B parameters
2,048 tokens
transformers
This model is a fine-tuned version of None. It has been trained using TRL. This model was trained with SFT.
Open weights
1B parameters
2,048 tokens
transformers
This model is a fine-tuned version of None. It has been trained using TRL. This model was trained with SFT.
Open weights
1B parameters
2,048 tokens
transformers
This model is a fine-tuned version of None. It has been trained using TRL. This model was trained with SFT.
Open weights
1B parameters
2,048 tokens
transformers
This model is a fine-tuned version of None. It has been trained using TRL. This model was trained with SFT.
Open weights
1B parameters
2,048 tokens
transformers
This model is a fine-tuned version of EleutherAI/pythia-1b. It has been trained using TRL. This model was trained with SFT.
Open weights
1B parameters
2,048 tokens
transformers
This model is a fine-tuned version of EleutherAI/pythia-1b. It has been trained using TRL. This model was trained with SFT.
Open weights
1B parameters
2,048 tokens
transformers
Open weights
Open weights
Open weights
Open weights
1B parameters
2,048 tokens
Open weights
Open weights
Open weights