CDAE Enhances BERT Embedding Robustness to Textual Perturbations

The Contrastive Denoising Autoencoder (CDAE) improves pretrained BERT embedding stability against synonym substitution and masking. It achieves this by jointly optimizing contrastive and reconstruction objectives to learn perturbation-invariant representations.