SPOKE Method Improves Strategic Poker Play via Preference Optimization
October 21, 2026
The Strategic Preference Optimization with KL-anchored Equilibrium (SPOKE) method outperforms SFT, DPO, and GRPO in hidden-information environments. Using a SmallThinker-4B policy, it achieved a mean exploitability of 0.213 in Kuhn poker and 1.081 in Leduc poker.
HOW THIS AFFECTS YOU
●
builderYou can implement these policy anchoring and risk constraints to improve agentic behavior in competitive environments.
●
researcherSPOKE provides a new framework for training agents to handle strategic reasoning and hidden information.