FusionEval Benchmarks Model Fusion Capability Retention and Compute Costs
October 23, 2026
FusionEval evaluates merging multi-expert models from Qwen3 and Llama bases across math, code, and tool-use domains. Experiments show training-free fusion methods maintain reasoning performance but cause significant degradation in tool-use capabilities.
HOW THIS AFFECTS YOU
●
builderBe cautious using training-free model fusion if your application relies heavily on tool-use functionality.
●
researcherYou can use this suite to measure how specific fusion methods impact individual expert capabilities versus average scores.