nlp-bucket-batching-seq2seq
Skillby wenmin-wu
Group variable-length sequences into length-sorted buckets before batching to minimize padding waste during seq2seq inference
Details
- Path
- skills/nlp/bucket-batching-seq2seq/SKILL.md
- Dependencies
- 1
Group variable-length sequences into length-sorted buckets before batching to minimize padding waste during seq2seq inference