Meta’s Generative Ads Recommendation Model (GEM), the foundation model behind ads recommendations across Instagram and Facebook, now trains at LLM scale on several thousand of the latest-generation GPUs. This post goes into the details on how we achieved: doubling end-to-end (E2E) training efficiency to 20–25% Model FLOPs Utilization (MFU) while scaling training FLOPs 4x in [...]
The post GEM Training: How Meta Doubled the Efficiency of Its LLM-Scale Ads Foundation Model appeared first on Engineering at Meta.
source & further reading
engineering.fb.com — original article
BlockTabBench: Evaluating Tabular Models Across Block's Machine Learning Ecosystem
Buzz Projects
Player 2 Has Entered the Game: Configuring Agents in Buzz 🐝