Domain Fine-Tuning Increases Numerical Hallucination in Financial Models

Controlled experiments show that domain-specific fine-tuning can actually degrade numerical accuracy in financial summarization tasks. The study identifies a three-level taxonomy of hallucinations, ranging from overt currency fabrication to covert, ungrounded quantitative claims.