SALT Improves Cross-Lingual Token Representations via Span-Level Supervision

SALT is a lightweight post-training method that injects span-level supervision into existing sentence encoders to fix the training-usage mismatch in token-level tasks. It achieves state-of-the-art results on four out of five multilingual token-level benchmarks while maintaining or improving sentence-level performance.