Register tokens enhance feature map quality in Diffusion Transformers (DiTs), particularly in pixel-space training. While DiTs lack the high-norm patch-token outliers seen in ViTs, registers still produce cleaner intermediate representations at high noise levels.
HOW THIS AFFECTS YOU
●
researcherYou can improve DiT feature map cleanliness by implementing register tokens during pixel-space training.