Last Translation Benchmark for Stress-Testing Multimodal Translation Models

The Last Translation Benchmark provides human-authored, peer-reviewed multimodal examples designed to break current state-of-the-art machine translation models. It addresses the saturation and unreliability of standard automatic metrics and gold human evaluation in translation research.