Amazon releases 51-language dataset for language understanding

Amazon releases 51-language dataset for language understanding

Amazon releases 51-language dataset for language understanding

“MASSIVE is a parallel dataset, meaning that every utterance is given in all 51 languages. This enables models to learn shared representations of utterances with the same intents, regardless of language, facilitating cross-linguistic training on natural-language-understanding (NLU) tasks. It also allows for adaptation to other NLP tasks such as machine translation, multilingual paraphrasing, new linguistic analyses of imperative morphologies, and more…”

Source: www.amazon.science/blog/amazon-releases-51-language-dataset-for-language-understanding