Turing-NLG: A 17-billion-parameter language model by Microsoft – Microsoft Research

Turing-NLG: A 17-billion-parameter language model by Microsoft – Microsoft Research

Turing-NLG: A 17-billion-parameter language model by Microsoft – Microsoft Research

This figure was adapted from a similar image published in DistilBERT. Turing Natural Language Generation (T-NLG) is a 17 billion parameter language model by Microsoft that outperforms the state of the art on many downstream NLP tasks. We present a demo of the model, including its freeform generation, question answering, and summarization capabilities, to academics …

Source: www.microsoft.com/en-us/research/blog/turing-nlg-a-17-billion-parameter-language-model-by-microsoft/