PoolBench Evaluates Pooling Strategies for Decoder-Only LLM Representations
August 7, 2026
PoolBench provides a standardized benchmark to evaluate how pooling strategies collapse token-level hidden states into passage-level vectors. Tested on Llama-3.1-8B, Gemma-2-9B, and Mistral-7B, the benchmark identifies W4_hierarchical as a superior method for linear separability and concept prevalence.
HOW THIS AFFECTS YOU
●
builderYou can optimize how you compress LLM outputs into searchable or classifiable embeddings.
●
researcherYou can use this framework to make principled decisions about vector representation design.