google/tapas-medium

TAPAS medium model is a BERT-like transformers model pretrained on a large corpus of English data from Wikipedia in a self-supervised fashion . The model was pre-trained on MLM and an additional step which the authors call intermediate pre-training . It uses relative position embeddings by default (i.e. resetting the position index at every cell of the table). The other (non-default) version which can be used is the one with absolute position embeddeddings:. The model card has been written by the Hugging Face team and contributors . It's mostly intended to be fine-tuned on a downstream task such as question answering or sequence,