Vision-Language Models Struggle with Temporal Commonsense Reasoning

A new corpus of geotagged tweets co-annotated by humans and LLMs reveals that state-of-the-art vision-language models fail to accurately infer event durations. Error analysis shows models overlook subtle semantic cues and hashtags, relying too heavily on prominent visual features instead of contextual information.