Japanese LLM Robustness Vulnerability to Character Transposition and Replacement

Evaluation of eleven Japanese and multilingual LLMs across JMMLU, JCommonsenseQA, and JamC-QA reveals that character transposition and replacement significantly degrade accuracy. Conversely, Japanese-specific errors like IME conversion and homophone substitution show relatively limited impact on model performance.