Embedding Models Struggle with Stance-Aware Argument Retrieval

Dense embedding models show a significant bias toward topical overlap and fail to capture instructional stance in asymmetric reasoning tasks. Contrastive training to correct this bias often leads to a secondary failure mode where models over-fixate on polarity keywords like supports or refutes.