Oct 13, 2026
Meta’s Generative Ads Model (GEM): Scaling the Central Model and Compute Engine for Frontier Ads AI · Engineering at Meta
Science, Technology & Innovation · Oct 13, 2026
Meta presents user-history length as a major scaling axis for ad recommendation: longer behavioral sequences increasingly benefit larger models. GEM doubled production context length and supports scaling to 25×, while OneSeq unifies heterogeneous events chronologically and CompSkip cuts sequence-module FLOPs by 43% with negligible quality loss. The key lesson is to optimize model size, memory, sequence efficiency, and event-history normalization together, since efficient computation enables longer context and longer context improves accuracy.
Meta’s Generative Ads Model (GEM): Scaling the Central Model and Compute Engine for Frontier Ads AI · Engineering at Meta
Science, Technology & Innovation · Oct 13, 2026
Meta’s 2026 GEM architecture, Kunlun, reportedly achieves major recommendation-model scaling gains through hardware–architecture co-design: linearized sparse attention, fused attention-style FFN computation, and distributed expert interactions. The results suggest that RecSys progress depends less on simply adding parameters or accelerators and more on workload-specific kernels, long-history representations, and efficient parallelism.
Meta’s Generative Ads Model (GEM): Scaling the Central Model and Compute Engine for Frontier Ads AI · Engineering at Meta
Science, Technology & Innovation · Oct 13, 2026
GEM transfers the intelligence of a large, latency-intensive model to real-time ad rankers through two paths: LoopFM precomputes compact long-context user representations, while Solaris asynchronously generates fresh candidate-specific embeddings with hierarchical fallbacks. This lets many downstream models benefit from GEM without running it on every live ad request or adding serving latency.
Meta’s Generative Ads Model (GEM): Scaling the Central Model and Compute Engine for Frontier Ads AI · Engineering at Meta
Science, Technology & Innovation · Oct 13, 2026
Meta improved recommendation-model training efficiency to 20–25% end-to-end FLOPS utilization while scaling total training compute 4× by jointly optimizing specialized kernels, ultra-low-precision training, topology-aware parallelism, communications, and memory—not by tuning GPUs or networking independently. The result highlights that expanding clusters alone may be uneconomical for heterogeneous recommendation workloads, which are harder to optimize than typical LLM workloads.
Meta’s Generative Ads Model (GEM): Scaling the Central Model and Compute Engine for Frontier Ads AI · Engineering at Meta
Science, Technology & Innovation · Oct 13, 2026
Meta’s GEM central ads foundation model jointly learns clicks and conversions across surfaces, improving reported conversion by 18.9% and CTR by 12%, while retaining specialized downstream serving models for domain-specific, low-latency ad delivery.