Decision Fine-Tuning Underperforms Reranker Fine-Tuning for Retrieval Tasks
October 26, 2026
Experiments on Qwen backbones (0.6B to 27B) demonstrate that decision fine-tuning (System One models) is inferior to standard reranker fine-tuning for information retrieval. For models up to 9B parameters, reranker fine-tuning improves nDCG@10 by 5 to 29 points over decision-tuned versions.
HOW THIS AFFECTS YOU
●
builderAvoid using decision-mode calibrated models for reranking tasks if performance is your primary metric.
●
researcherThe results suggest decision fine-tuning does not inherently optimize for the ranking objectives required in retrieval.