Asymmetric Quantization Enables 97% Storage Reduction for Late Interaction Retrieval

Asymmetric quantization facilitates near-lossless retrieval for late interaction models like Wholembed v3, which produce hundreds of vectors per document. This method addresses the high storage overhead of multi-vector architectures, enabling billion-document scale retrieval within object storage environments.