Self-Rewarded Moral Argumentation Improves LLM Decisiveness and Invariance
October 23, 2026
Training LLMs via self-judged tournaments on argument quality increases decisiveness and reduces response order bias in moral tasks. While the policy adopts rewarded language registers, performance on benchmarks like MoralChoice shows that sycophancy and reframing issues persist despite improved argumentation.
HOW THIS AFFECTS YOU
●
researcherYou can explore reinforcement learning using self-rewarded argumentation to improve reasoning quality.
●
policyThe finding that models remain susceptible to sycophancy despite better argumentation is critical for safety evaluations.