Multi-Turn Generation Trajectories for Scientific Document Pre-training
August 27, 2026
A new pipeline unfolds scientific papers into multi-turn trajectories consisting of writing requests, global plans, and section-level deliberations. This method creates a continued pre-training corpus roughly twice the size of the original source text by reconstructing the underlying reasoning process.
HOW THIS AFFECTS YOU
●
researcherYou can use these structured reasoning trajectories to improve how models learn long-form document structure and scientific logic.