ListQA is a new benchmark consisting of 9,045 human-curated questions requiring LLMs to retrieve and organize multiple facts into lists of 3-10 elements. It uses bipartite matching and semantic grading to measure accuracy across hierarchical and flat structures.
HOW THIS AFFECTS YOU
●
researcherYou can use this to better evaluate how models handle complex, multi-step factual retrieval tasks.