allenai/led-base-16384

This notebook shows how led-base-16384 can effectively be fine-tuned on a downstream task . The model is especially interesting for long-range summarization and question answering . This notebook is based on Allenai's Longformer Encoder-Decoder (LED) and Bart-base's position embedding matrix . It was created using the same architecture as bart-base, which was used to process 16K tokens . The notebook was written by Allenai and Iz Beltagy, Matthew E. Peters, Arman Cohan, and Arman P. Cohan . It is published on Amazon.com for $1.99/www.journey.com/ledbase-,