MerchantBench Evaluates LLM Agent Coherence in E-Commerce Workflows

MerchantBench provides a new benchmarking framework specifically designed to measure the long-term coherence of LLM agents performing multi-step e-commerce tasks. It focuses on how agents maintain state and logic consistency across extended operational sequences rather than single-turn interactions.