This model was trained using Amazon SageMaker and the new Hugging Face Deep Learning container.
Search public pages, research tools, and SAVRN solutions.
Independent publisher
philschmid
This model was trained using Amazon SageMaker and the new Hugging Face Deep Learning container.
This model is a fine-tune checkpoint of DistilBERT-base-cased, fine-tuned using (a second step of) knowledge distillation on SQuAD v1.1. This model reaches a F1 score of 87.1 on the dev set (for comparison, BERT bert-base-cased version reaches a F1 score of 88.7).