Pianist Transformer Pre-Trains on 10B MIDI Tokens for Expressive Rendering

Pianist Transformer applies self-supervised pre-training on 10 billion tokens of unlabeled MIDI data to expressive piano performance rendering, bypassing the small labeled dataset constraint that limits prior supervised approaches. An asymmetric Transformer with note-level compression improves training efficiency and inference speed for long-context music sequences. The model achieves state-of-the-art rendering with an editable workflow.