google/tapas-base-finetuned-tabfact

TAPAS is a BERT-like transformers model pretrained on a large corpus of English data from Wikipedia in a self-supervised fashion . It was pre-trained on MLM and an additional step which the authors call intermediate pre-training, and then fine-tuned on Tabular Fact Checking (TabFact) It uses relative position embeddings by default (i.e. resetting the position index at every cell of the table) The latest version, which is the default one, corresponds to the tapas_tabfact_inter_masklm_base_reset checkpoint of the original Github repository . The other (non-default) version which can be,