●builderYou can use these optimized kernels and scheduling techniques to reduce latency in large-scale production deployments.
●researcherThe release provides access to specific MoE parallelism and speculative decoding implementations used in production-scale models.