Relation Geometry in Semantic Space of Language Models

Title: Relation Geometry in Semantic Space of Language Models Source: arxiv Experiments demonstrate how semantic relations influence the geometric distribution of word vectors in language model embeddings. The study tests whether relational properties like symmetry and transitivity are encoded in vector displacement and determines if semantic structure relies more on surface forms or contextual information.