TaBERT: A new model for understanding queries over tabular data

“TaBERT is the first model that has been pretrained to learn representations for both natural language sentences and tabular data. These sorts of representations are useful for natural language understanding tasks that involve joint reasoning over natural language sentences and tables. A representative example is semantic parsing over databases, where a natural language question (e.g., “Which country has the highest GDP?”) is mapped to a program executable over database (DB) tables…”

Source: https://ai.facebook.com/blog/tabert-a-new-model-for-understanding-queries-over-tabular-data/