MindAlign Decodes Inner Speech from fMRI via Two-Stage Semantic Alignment

MindAlign maps fMRI signals to a shared multimodal semantic space in a first stage, then prompts a frozen multimodal LM with the resulting semantic sketch plus visual context for open-ended text generation. The decoupled design avoids fine-tuning the language model, improving scalability across subjects with limited data.