Activation-Based Reward-Hack Detection Needs Context Features to Predict Agent Exploits

In ReAct-style agents on ALFWorld and WebShop, activation-based reward-hack scores alone are insufficient to predict exploit actions; combining token-level entropy and decision-context features significantly improves next-step risk estimation. Fine-tuned adapters trained on a reward-hacking dataset transfer hacking tendencies into agentic action selection when environments expose proxy-reward affordances.