[arXiv]score: 0.44

Deep Research Pretraining via Predictive Navigation on Citation Graphs

August 4, 2026

Deep Research Pretraining (DRP) uses offline trajectories derived from citation and hyperlink structures to teach models research behaviors. Pretraining Qwen3-14B-Base on 1B tokens via DRP improves performance on search-open-write tasks without requiring live environment rollouts.

HOW THIS AFFECTS YOU

●

builderThis method provides a path to pretrain specialized research agents using massive amounts of static web and scholarly data.

●

researcherYou can derive supervision signals for agentic research tasks using existing document structures rather than expensive live trajectories.

read original ↗arxiv.org

DAILY DIGEST

you don't check 9 sources — we do. one email every morning, read in 2 min. free. unsubscribe anytime. privacy

← back to feed