Google Research Datasets

The benchmark consists of around 1,000 crowd-sourced Python programming problems, designed to be solvable by entry level programmers, covering programming fundamentals, standard library functionality, and so on. Each problem consists of a task description, code solution and 3 automated test cases. As described in the paper, a subset of the data has been hand-verified by us. Released here as part of Program Synthesis with Large Language Models, Austin et. al., 2021. This dataset is used to evaluate code generations. English - Python code - sourcefile: unknown - text/prompt: description of programming task - code: solution for programming task - testsetupcode/testimports: necessary code…

This dataset contains 108,463 human-labeled and 656k noisily labeled pairs that feature the importance of modeling structure, context, and word order information for the problem of paraphrase identification. The dataset has two subsets, one based on Wikipedia and the other one based on the Quora Question Pairs (QQP) dataset. For further details, see the accompanying paper: PAWS: Paraphrase Adversaries from Word Scrambling (https://arxiv.org/abs/1904.01130) PAWS-QQP is not available due to license of QQP. It must be reconstructed by downloading the original data and then running our scripts to produce the data and attach the labels. The text in the dataset is in English. Below are two…

The NQ corpus contains questions from real users, and it requires QA systems to read and comprehend an entire Wikipedia article that may or may not contain the answer to the question. The inclusion of real user questions, and the requirement that solutions should read an entire page to find the answer, cause NQ to be a more realistic and challenging task than prior QA datasets. An example of 'train' looks as follows. This is a toy example. The data fields are the same among all splits. - id: a string feature. - document a dictionary feature containing: - title: a string feature. - url: a string feature. - html: a string feature. - tokens: a dictionary feature containing: - token: a string…