This model is a fine-tuned version of facebook/wav2vec2-xls-r-300m on the private datasets in 2 stages - firstly was fine-tuned on a small dataset with good samples Then the obtained model was fine-tuned on a large dataset with the small good dataset, with various samples from different sources, and with an unlabeled dataset that was weakly labeled using a previously trained model. (weakly labeled data wasn't used in validation set) on small dataset on large dataset on small dataset on large dataset The following hyperparameters were used during training: - learningrate: 0.0003 - trainbatchsize: 8 - evalbatchsize: 8 - distributedtype: multi-GPU - numdevices: 2 - gradientaccumulationsteps: 4…