# ultrachat_200k by Hugging Face H4: AI Training Dataset Source: https://savrn.com/datasets/ultrachat-200k Markdown alternate of the page above; the site index is https://savrn.com/llms.txt --- ## Dataset Card By Hugging Face H4, published under mit, revision 8049631c405a. ### Dataset Card for UltraChat 200k ### Dataset Description This is a heavily filtered version of the [UltraChat](https://github.com/thunlp/UltraChat) dataset and was used to train [Zephyr-7B-β](https://huggingface.co/HuggingFaceH4/zephyr-7b-beta), a state of the art 7b chat model. The original datasets consists of 1.4M dialogues generated by ChatGPT and spanning a wide range of topics. To create UltraChat 200k, we applied the following logic: - Selection of a subset of data for faster supervised fine tuning. - Truecasing of the dataset, as we observed around 5% of the data contained grammatical errors like "Hello. how are you?" instead of "Hello. How are you?" - Removal of dialogues where the assistant replies with phrases like "I do not have emotions" or "I don't have opinions", even for fact-based prompts that don't involve either. ### Dataset Structure The dataset has four splits, suitable for: - Supervised fine-tuning (sft). - Generation ranking (gen) via techniques like rejection sampling or PPO. The number of examples per split is shown as follows: [Read the full dataset card (376 words)](https://savrn.com/datasets/ultrachat-200k/card) ## Structure ### default 515,311 rows | Split | Rows | Size | | --- | --- | --- | | train_sft | 207,865 | 1.4 GB | | test_sft | 23,110 | 154.2 MB | | train_gen | 256,032 | 1.3 GB | | test_gen | 28,304 | 150.3 MB | promptstringprompt_idstringmessageslist ## Details Repository HuggingFaceH4/ultrachat_200k Publisher Hugging Face H4 Task category Text generation Tags Not stated by the source Size category 100K