GeLaCo: Evolutionary layer compression via parameterized weight merging

GeLaCo uses population-based evolutionary search to compress LLMs through a novel layer collapse method. It optimizes for similarity over residual updates and language modeling KL divergence to reduce model size while preserving capacity.