Image Tokenizers Should Be Trained Between Images

InterpTok improves latent diffusion image reconstruction by fine-tuning the MAETok decoder on linear interpolations between training image tokens. This method addresses distribution shifts where generated codes fall between discrete training samples, reducing decoding artifacts compared to standard Gaussian noise augmentation techniques.