Contemplating Meta’s Homegrown MTIA Compute Engine Roadmap
… I also detailed how Meta Platforms had created what amounts to a memory hypervisor, called “Neo,” that stages parameters and embeddings not only across the CPU and GPU memory hierarchies within a node, but also across a cluster of machines. …