Style Leakage in Factorized Generative Models via Marginal Matching

Matching marginal distributions to a Gaussian prior fails to ensure latent style independence from class labels. Experiments show models achieving near-zero global MMD while linear probes recover class labels with 74% to 100% accuracy.