The vLLM project has merged a pull request to enable support for TML Inkling. This expands the range of models compatible with the vLLM inference runtime.
HOW THIS AFFECTS YOU
●
builderYou can integrate TML Inkling into your production inference pipeline via vLLM.