Multi-Token Prediction and New Tokenization Solve Graph Search Scaling Limits

Multi-token prediction (MTP) and alternative tokenization methods overcome scaling walls in latent multi-hop graph search tasks. These methods allow language models to consistently find shortest paths in unseen graphs at scales previously unattainable by standard training objectives.