ART Fine-Tunes Frozen MLLMs via Visual Input Optimization, Bypassing LoRA Limits

ART fine-tunes multimodal LLMs by backpropagating gradients into raw pixel arrays rather than model weights, keeping the computational graph frozen and making it compatible with precompiled high-throughput engines like vLLM. This sidesteps the graph modification requirements of LoRA and soft prompting.