Contemplating Meta’s Homegrown MTIA Compute Engine Roadmap
… I went through this in detail with a drilldown on the “Zion” and “ZionEX” and “Grand Teton” hybrid CPU-GPU systems designed by Meta Platforms way back in October 2022 , showing how the DLRMs were just as parameter-intense and flops-hungry as the LLMs of the time. …