Published dictionaries have recorded the Sicilian language in a consistent orthography for several hundred years. Most notably: Pasqualino (1785), Traina (1868), Mortillaro (1876) and Nicotra (1883). Nonetheless, the Sicilian language text that Facebook collected during the No Language Left Behind project (2022) exhibits extreme orthographic diversity which (when incorporated into a training dataset) causes a model to generate a patchwork of different Sicilian dialects with each phrase seemingly sourced from a different town or province. And to make matters worse, very few of the Sicilian-English pairs that the NLLB project collected are translations, which makes the collection almost…
Publicly accessible
cc-by-sa-4.0
100K<n<1M
Published dictionaries have recorded the Sicilian language in a consistent orthography for several hundred years. Most notably: Pasqualino (1785), Traina (1868), Mortillaro (1876) and Nicotra (1883). Nonetheless, the Sicilian language text that Facebook collected during the No Language Left Behind project (2022) exhibits extreme orthographic diversity which (when incorporated into a training dataset) causes a model to generate a patchwork of different Sicilian dialects with each phrase seemingly sourced from a different town or province. And to make matters worse, very few of the Sicilian-English pairs that the NLLB project collected are translations, which makes the collection almost…
Publicly accessible
odc-by
100K<n<1M
Published dictionaries have recorded the Sicilian language in a consistent orthography for several hundred years. Most notably: Pasqualino (1785), Traina (1868), Mortillaro (1876) and Nicotra (1883). Nonetheless, the Sicilian language text that Facebook collected during the No Language Left Behind project (2022) exhibits extreme orthographic diversity which (when incorporated into a training dataset) causes a model to generate a patchwork of different Sicilian dialects with each phrase seemingly sourced from a different town or province. And to make matters worse, very few of the Sicilian-English pairs that the NLLB project collected are translations, which makes the collection almost…
Publicly accessible
odc-by
100K<n<1M
Published dictionaries have recorded the Sicilian language in a consistent orthography for several hundred years. Most notably: Pasqualino (1785), Traina (1868), Mortillaro (1876) and Nicotra (1883). Nonetheless, the Sicilian language text that Facebook collected during the No Language Left Behind project (2022) exhibits extreme orthographic diversity which (when incorporated into a training dataset) causes a model to generate a patchwork of different Sicilian dialects with each phrase seemingly sourced from a different town or province. And to make matters worse, very few of the Sicilian-English pairs that the NLLB project collected are translations, which makes the collection almost…
Publicly accessible
odc-by
100K<n<1M