microsoft/prophetnet-large-uncased

ProphetNet is a new pre-trained language model for sequence-to-sequence learning with a novel self-supervised objective called future n-gram prediction . The model could e.g. be trained on headline generation as follows: "us rejects charges against its ambassador in bolivia" The original implementation is Fairseq version at Github repo at the end of this article . For more information on the project, visit Fairseq.com/ProphetNet and the original version of the project is available at the link to the Fairseq repo at http://://www.fqqqfqg.org/prophetnet-large-uncased-prophetNet-full-,