PoolDPP uses a determinantal point process to sample diverse subsets of strings from a candidate pool. The method uses importance-weighting and a K-DPP sampler to prevent semantic clustering, with KL divergence decaying at O(1/N) relative to pool size.
HOW THIS AFFECTS YOU
●
builderYou can improve the variety of outputs in open-ended generation tasks by using a candidate pool and this sampler.
●
researcherYou can use this formal framework to model repulsion between outputs using embedding geometry.