LLM Failure to Learn Stochastic Limit Order Book Dynamics

LLMs trained on synthetic limit order book data can generate valid event sequences but fail to build an accurate internal world model of the book's state. This deficiency causes biased estimates and spurious predictability when attempting to forecast future market events.