google/tapas-tiny-finetuned-wtq

TAPAS is a BERT-like transformers model pretrained on a large corpus of English data from Wikipedia in a self-supervised fashion . The model was pre-trained on MLM and an additional step which the authors call intermediate pre-training, and then fine-tuned in a chain on SQA, WikiSQL and finally WTQ . It uses relative position embeddings (i.e. resetting the position index at every cell of the table) The default version corresponds to the tapas_wtq_wikisql_sqa_inter_masklm_tiny_reset checkpoint of the original Github repository . The other (non-default),