Retrieved-Span Training for Efficient Query-Focused Meeting Summarization on QMSum

Retrieved-Span Training optimizes query-focused meeting summarization by fine-tuning a 406M Fusion-in-Decoder model on 2,000-word retrieved spans rather than long transcripts. This approach achieves 36.33 ROUGE-1, matching a 1.2B parameter system while using one-third the parameters and less than half the peak inference memory.