UltraViT: Latency-Optimized Vision Encoder for On-Device LVLMs

UltraViT introduces a pyramidal vision encoder architecture specifically designed to minimize latency in Large Vision-Language Models on edge devices. It optimizes the vision component of LVLMs, which is typically a computational bottleneck in resource-constrained environments.