The vLLM inference runtime now includes support for the zerank-2 reranker model. This integration allows for high-throughput serving of reranking tasks within the existing vLLM ecosystem.
HOW THIS AFFECTS YOU
●
builderYou can now deploy zerank-2 reranking workloads directly through the vLLM inference engine.