Better Boundary Prediction Does Not Guarantee Better Structural Representation

Title: Better Boundary Prediction Does Not Guarantee Better Structural Representation Source: arxiv Training models on punctuation restoration tasks fails to improve downstream performance on semantic, argument, or syntactic structure tasks. Evaluation across decoder-only, encoder-only, and encoder-decoder architectures under 1B parameters shows that optimizing for phrase boundary prediction does not correlate with higher-quality structural representation.