NYU Researcher Explains Why LLMs Fail at Playing Video Games

LLMs can generate game code but consistently fail at playing games, according to NYU Game Innovation Lab director Julian Togelius. The gap likely stems from real-time perception, action sequencing, and spatial reasoning demands that differ fundamentally from next-token prediction.