A Repository of Conversational Datasets

Abstract

Progress in Machine Learning is often driven by the availability of large datasets, and consistent evaluation metrics for comparing modeling approaches. To this end, we present a repository of conversational datasets consisting of hundreds of millions of examples, and a standardised evaluation procedure for conversational response selection models using '1-of-100 accuracy'. The repository contains scripts that allow researchers to reproduce the standard datasets, or to adapt the pre-processing and data filtering steps to their needs. We introduce and evaluate several competitive baselines for conversational response selection, whose implementations are shared in the repository, as well as a neural encoder model that is trained on the entire training set.

Full paper on arXiv · Code

Details

arXiv identifier

1904.06472

Published

2019-04-13

Authors

Matthew Henderson, Paweł Budzianowski, Iñigo Casanueva, Sam Coope, Daniela Gerz, Girish Kumar, Nikola Mrkšić, Georgios Spithourakis, Pei-Hao Su, Ivan Vulić, Tsung-Hsien Wen

Models That Cite This Paper

• Described byall-MiniLM-L6-v2
• Described byall-mpnet-base-v2
• Described byall-MiniLM-L12-v2
• Described byall-distilroberta-v1
• Described byall-roberta-large-v1