LLMs Prioritize Rule-Based Instructions Over Few-Shot Examples

Research shows LLMs learn more reliably from explicit rule descriptions than from input-output demonstrations. Scaling the number of examples or adding examples to rules does not consistently improve performance, as instruction tuning specifically amplifies rule-following capabilities.