vLLM has added support for the ZAYA1 model to its inference runtime. This expansion improves the availability of optimized serving for the ZAYA1 architecture.
HOW THIS AFFECTS YOU
●
builderYou can now use the vLLM engine for high-performance serving of ZAYA1.