vToken Virtualization Reduces LLM KV Cache Fragmentation

vToken introduces a token-level virtualization layer that decouples logical token liveness from physical block placement to solve intra-block fragmentation in PagedAttention. The implementation in vLLM allows for more efficient asynchronous reclamation of KV memory.