Trustworthiness Costs in Domain-Adapted Small Language Models

An empirical study of TinyLlama 1B, Gemma-2 2B, and Llama 3.2 1B shows how parameter-efficient fine-tuning impacts factual calibration and adversarial robustness across healthcare, legal, and finance domains. Evaluation uses TruthfulQA MC2 to quantify trade-offs between performance gains and trustworthiness under different LoRA and DPO strategies.