Restricted Evidence Visibility Enhances Compositional Generalization in LLM Societies

Restricting information visibility between modules in multi-agent language model societies improves compositional generalization. In tests using shared pretrained models and low-rank adapters, restricted-visibility groups outperformed globally visible groups by over 20 points on natural-language function-composition tasks.