Nvidia Finally Admits Why It Shelled Out $20 Billion For Groq
… Here is how the Hopper NVL8, Grace-Blackwell NVL72, and Vera-Rubin NVL72 systems stack up in terms of throughput tokens per second per megawatt and interactivity tokens per second per user : It is immediately obvious that the larger shared GPU memory domain enabled by NVSwitch helps stretch the cur… …