Async-RBench Evaluates Asynchronous Task Execution in LLM Agents

Async-RBench introduces a benchmark of 200 tasks to evaluate how LLM agents manage asynchronous subagent results and shifting task states. It utilizes a Dynamic Replanning Score (DRS) to measure how agents handle non-deterministic result arrivals and state updates through an Event Response Contract.