PyTorch publishes In-Kernel Broadcast Optimization for RecSys inference

Meta's PyTorch team detailed In-Kernel Broadcast Optimization (IKBO), a kernel-model-system co-design that fuses broadcast logic directly into user-candidate kernels. It eliminates the explicit replication of shared user embeddings/sequences per candidate that traditional RecSys inference relies on.