Classical World Models Face Irreducible Error in Complex Environments

Classical world models fail to align optimal agent policies with true environments when outcomes depend on long-term history. Even with increased memory, finite classical models eventually lose the ability to distinguish optimal actions or repeatedly assign high expected rewards to suboptimal ones.