CoT Weighting Strategies for Small Medical Language Models

Evaluating supervised fine-tuning methods for models under 9B parameters shows that Segment-weighted (SwS) loss weighting outperforms Uniform-across-Sequence (UaS) on medical multiple-choice QA. Specifically, Qwen3.5-4B achieved a 44.8% improvement over its zero-shot baseline on MedQA using SwS.