The vLLM inference runtime has merged support for the Dory model. This addition expands the library of high-performance models available for scalable deployment via vLLM.
HOW THIS AFFECTS YOU
●
builderYou can now deploy Dory models using vLLM's optimized inference engine.
●
researcherThis facilitates easier benchmarking and deployment of Dory within standardized inference frameworks.