LLMs Show Poor Bidirectional Semantic Relation Knowledge
October 14, 2026
A new evaluation task requires LLMs to predict semantic relations between word glosses in different orders across five languages. Experiments with 17 LLMs reveal generally poor performance, with only eight models achieving significant F1 scores above chance.
HOW THIS AFFECTS YOU
●
researcherThis demonstrates a fundamental weakness in how current LLMs represent cross-lingual lexical semantics.