Gap Identified Between Policy Following and Learning via Textual Feedback

Research into TextGrad-style optimization shows that while human-written policies improve 7B agent success on TextWorldExpress by 5.0 points, policies generated from agent trajectories fail to outperform fixed prompting. The findings suggest that current methods for deriving textual policies from experience are insufficient for agent-level optimization.