HHousen/distil-led-large-cnn-16384

This checkpoint should be loaded into LEDForConditionalGeneration.from_pretrained . See the LED documentation for more information . To process 16K tokens, sshleifer/distilbart-cnn-12-6's position embedding matrix was simply copied 16 times . This checkpoint was created from allenai/led-large-16384, in a fashion similar to the previous version of this checkpoint . The code is used to process the tokens and process them in a similar fashion to the current version of the code used to handle the 16K token size of 16K . This is the same as the previous checkpoint used for the previous generation of the LED project. See the,