[arXiv]score: 0.17
TaDA Merges Task and Domain LoRA Adapters Training-Free via Layer-Depth Gating
June 4, 2026
TaDA is a training-free LoRA merging algorithm that exploits a depth-dependent asymmetry: task signals dominate shallow layers while domain signals dominate deeper ones. Per-layer probe-guided gating and subspace-aware merging discard conflicting singular directions before combining adapters, outperforming symmetric merging baselines.
cs.CL
HOW THIS AFFECTS YOU
●
builderYou can merge task and domain LoRA adapters without retraining using TaDA's layer-depth gating — directly useful if you maintain separate fine-tuned adapters and want a single deployable model.
●
researcherThe depth-dependent task-domain asymmetry finding is a transferable architectural insight worth validating across more model families and adapter types.