AcCoRD Benchmark for Dynamic User-Agent Preference Collaboration
August 31, 2026
AcCoRD evaluates how frontier LLMs handle evolving and mid-interaction user preferences in shopping and travel domains. Results show that while models handle underspecification, they struggle with preferences that emerge or change during a session, even with uncertainty-guided prompting.
HOW THIS AFFECTS YOU
●
builderYou need more sophisticated uncertainty modeling to build agents that adapt to changing user needs.
●
designerThis highlights the need for UX patterns that allow users to correct or update preferences mid-flow.