What Does Fr\'echet Distance Measure? A Directional Decomposition

Directional Fréchet distance decomposes the Fréchet distance scalar into the expected squared projection of optimal transport displacements along specific vectors. This method identifies the underlying distributional discrepancies in images, videos, and protein structures, revealing why metrics like FID may diverge from human-centric or task-specific reward scores.