Taxonomy of Model Fusion for Large Language Models

This survey categorizes LLM model fusion into three hierarchical levels: parameter-level, representation-level, and behavior-level. It provides a systematic framework for integrating capabilities from multiple source models into single target models to improve reuse and capability density.