[arXiv]score: 0.31
Index-Pretrained Transformer Reduces Binary Cross-Entropy for Stock Prediction from 0.69 to 0.64
May 26, 2026
Pre-training a transformer on TSX index intra-day returns before fine-tuning on individual stocks reduces binary cross-entropy loss from 0.69 to 0.64, outperforming LSTM and XGBoost on regression MSE but not on ensemble average accuracy.
q-fin.STcs.LG
HOW THIS AFFECTS YOU
●
researcherIndex-level pre-training provides a modest but measurable improvement in individual stock prediction, though the gains are task-dependent and don't uniformly dominate ensemble baselines.