A closer look at Nvidia's Groq-powered LPX rack systems
… That compute is tied to a relatively large pool of SRAM memory, which is orders of magnitude faster than the high-bandwidth memory HBM found in GPUs today, but is also incredibly inefficient in terms of space required. Each LPU only has enough die space for 500 MB of on-chip memory. …