Explorative Modeling Adds Third Pretraining Axis for End-to-End Generation

The paper introduces a third pretraining axis to enable end-to-end generation capabilities. This method aims to move beyond standard text-only or multimodal paradigms by integrating a new dimension of training data into the model architecture.