Meta's optimized recommendation system inference

Meta introduced In-Kernel Broadcast Optimization (IKBO), a hardware-software co-design that eliminates redundant embedding replication in recommendation system inference.