HN-CLIP Uses Adaptive Similarity Margins for Dense-Caption Retrieval
August 20, 2026
HN-CLIP addresses InfoNCE optimization saturation in dense-caption retrieval by using a text encoder's internal geometry to construct per-negative adaptive similarity margins. This method prevents gradient vanishing in fp32 by resolving near-duplicate captions that standard contrastive objectives fail to separate.
HOW THIS AFFECTS YOU
●
builderYou can improve retrieval performance on dense-caption datasets by implementing adaptive margins.
●
researcherThe method offers a way to bypass the gradient saturation issues common in contrastive fine-tuning.