Preference Optimization Trade-offs in Motivational Interviewing Agents

This study evaluates how Direct Preference Optimization (DPO) affects the balance between goal persistence and relational attunement in AI counselors. Using the AnnoMI corpus, the research examines whether penalizing specific failure modes in motivational interviewing leads to unintended behavioral shifts.