Reasoning Capabilities Do Not Uniformly Improve Psychological Depth in Stories
November 9, 2026
Blinded evaluations of short stories show that reasoning-heavy models do not necessarily produce better creative writing. In pairwise tests, GPT-5 was slightly preferred over GPT-4o (60.0-62.9%), but DeepSeek-R1 actually performed worse than DeepSeek-V3 (42.9%) in terms of perceived psychological depth.
HOW THIS AFFECTS YOU
●
researcherReasoning benchmarks do not translate to better performance in open-ended creative tasks.
●
designerUsing reasoning-optimized models might actually decrease the quality of creative or nuanced text generation.