Back to feed

Meta’s Generative Ads Model (GEM): Scaling the Central Model and Compute Engine for Frontier Ads AI

Engineering at Meta

Oct 13, 2026

10/13/2026

Longer User History Context With Efficient Sequence Processing Enables Larger Models And Requires Attention To Memory And Normalization

Meta’s Generative Ads Model (GEM): Scaling the Central Model and Compute Engine for Frontier Ads AI · Engineering at Meta

Science, Technology & Innovation · Oct 13, 2026

Meta presents user-history length as a major scaling axis for ad recommendation: longer behavioral sequences increasingly benefit larger models. GEM doubled production context length and supports scaling to 25×, while OneSeq unifies heterogeneous events chronologically and CompSkip cuts sequence-module FLOPs by 43% with negligible quality loss. The key lesson is to optimize model size, memory, sequence efficiency, and event-history normalization together, since efficient computation enables longer context and longer context improves accuracy.


10/13/2026

Recommendation Models Achieve LLM-Like Scaling Through Co-Designed Architectures And Hardware Optimizations Rather Than Parameter Growth Alone

Meta’s Generative Ads Model (GEM): Scaling the Central Model and Compute Engine for Frontier Ads AI · Engineering at Meta

Science, Technology & Innovation · Oct 13, 2026

Meta’s 2026 GEM architecture, Kunlun, reportedly achieves major recommendation-model scaling gains through hardware–architecture co-design: linearized sparse attention, fused attention-style FFN computation, and distributed expert interactions. The results suggest that RecSys progress depends less on simply adding parameters or accelerators and more on workload-specific kernels, long-history representations, and efficient parallelism.


10/13/2026

Distributing Central Model Intelligence Across Real-Time Ad Ranking Through Precomputation And Asynchronous Evaluation

Meta’s Generative Ads Model (GEM): Scaling the Central Model and Compute Engine for Frontier Ads AI · Engineering at Meta

Science, Technology & Innovation · Oct 13, 2026

GEM transfers the intelligence of a large, latency-intensive model to real-time ad rankers through two paths: LoopFM precomputes compact long-context user representations, while Solaris asynchronously generates fresh candidate-specific embeddings with hierarchical fallbacks. This lets many downstream models benefit from GEM without running it on every live ad request or adding serving latency.


10/13/2026

Efficient Scaling Of Recommendation Models Requires Joint Optimization Across Compute Utilization, Mixed Precision, Model Partitioning, And Communications

Meta’s Generative Ads Model (GEM): Scaling the Central Model and Compute Engine for Frontier Ads AI · Engineering at Meta

Science, Technology & Innovation · Oct 13, 2026

Meta improved recommendation-model training efficiency to 20–25% end-to-end FLOPS utilization while scaling total training compute 4× by jointly optimizing specialized kernels, ultra-low-precision training, topology-aware parallelism, communications, and memory—not by tuning GPUs or networking independently. The result highlights that expanding clusters alone may be uneconomical for heterogeneous recommendation workloads, which are harder to optimize than typical LLM workloads.


10/13/2026

Centralized Ads Foundation Model Improves Cross-Domain Performance While Preserving Domain Specificity

Meta’s Generative Ads Model (GEM): Scaling the Central Model and Compute Engine for Frontier Ads AI · Engineering at Meta

Science, Technology & Innovation · Oct 13, 2026

Meta’s GEM central ads foundation model jointly learns clicks and conversions across surfaces, improving reported conversion by 18.9% and CTR by 12%, while retaining specialized downstream serving models for domain-specific, low-latency ad delivery.