Midtraining with synthetic documents improves model compassion on ANIMA benchmark

Midtraining on 3,000 synthetic documents achieves 77% on the ANIMA compassion benchmark, outperforming instruction-tuning at 40%. The effect degrades after 5,000 subsequent instruction-tuning samples, suggesting that document-based value interventions require explicit preservation strategies to remain stable during training.