Geometry-Aware Adapter Merging Offers No Consistent Gain Over Standard Averaging

Testing DoRA-RBAC on LLaMA-3.1-8B and Mistral-7B across GPQA, PubMedQA, SimpleQA, and WMDP benchmarks, Riemannian-inspired directional averaging provides no consistent multi-domain advantage over standard Euclidean merging, despite the theoretical appeal of orthogonality constraints. Single-domain performance matches LoRA baselines.