MedPIC-Bench Reveals LLM Failure in Counterfactual Medication Safety

MedPIC-Bench tests medication-safety reasoning using 467 expert-validated questions with counterfactual patient data. LLM accuracy dropped from 63.6% to 45.1% when patient-specific conditions changed, indicating a failure to integrate individual patient context into reasoning.