Benchmark Deficiencies in LLM Safety and Modality

Standard LLM evaluations often ignore modality differences and the impact of web search on safety. An audit of ChatGPT vs. OpenAI API shows that single-run accuracy metrics fail to capture critical variances in response consistency, citation grounding, and abstention behavior.