The vLLM project has merged support for Cosmos3-Edge via ModelOpt. This allows for optimized inference of the Cosmos3-Edge model within the vLLM framework.
HOW THIS AFFECTS YOU
●
builderUse vLLM to serve Cosmos3-Edge with ModelOpt optimizations for improved throughput.