Forecast-Dojo Benchmark Provides Replayable Environments for Forecasting Agents
September 25, 2026
Forecast-Dojo uses 1,568 Polymarket events and 18.8M dated news articles to create a replayable environment for training LLM forecasting agents. Evaluation shows that while research tools lower Brier scores, current models still underperform compared to historical market forecasts.
HOW THIS AFFECTS YOU
●
builderYou can use these environments to train agents to improve accuracy by integrating research tools and news feeds.
●
researcherYou can now benchmark forecasting agents against historical data without waiting for real-time event resolution.