[arXiv]score: 0.25

ICLHerd Data Selection Framework Balances Mode-Seeking and Mode-Averaging

October 21, 2026

ICLHerd uses a von Mises-Fisher kernel to prevent the mode-seeking bias common in cosine-similarity-based data selection. By using in-context learning as a validation proxy, the framework enables efficient hyperparameter tuning to balance mode-seeking with mode-averaging in LLM training sets.

HOW THIS AFFECTS YOU

●

builderYou can use this framework to curate higher-quality training data that generalizes better than similarity-based methods.

●

researcherThe use of von Mises-Fisher kernels offers a mathematical way to avoid data clustering around development samples.

read original ↗arxiv.org

DAILY DIGEST

you don't check 9 sources — we do. one email every morning, read in 2 min. free. unsubscribe anytime. privacy

← back to feed