… Nvidia plans to cram 256 of the chips into a new LPX rack system that'll be connected via a custom Spectrum-X interconnect to a neighboring Vera-Rubin NVL72 rack system. The GPUs will handle the compute-intensive prompt processing, while the LPUs spew out tokens. …
… Setting expectations Alongside new datacenter silicon, we also anticipate Huang will share more details about Nvidia's next-gen Kyber racks and Feynman GPUs, which should debut in 2027 and 2028. …
… These chips don't rely on conventional DRAM memory, and are designed to work alongside GPUs like Rubin to accelerate the token-generating decode phase of the inference pipeline. …
… In January, it announced that exports of Nvidia and AMD GPUs to China would only be allowed if there was sufficient supply of the same products in the US. …
… The chips also feature faster NVLink-C2C interconnects, enabling them to shuffle data to and from other CPU or GPUs at up to 900 GB/s advertised as 1.8 TB/s bidirectional bandwidth in either direction. …
… On Wednesday, the silicon photonics startup revealed it was working with ODM partner Wywinn to develop a new rack-scale reference platform capable of stitching more than 1,024 GPUs into a single unified system. …
… MORE CONTEXT Nvidia's on-again off-again H200 sales in China are now on again Chips... in spaaaace – courtesy of Nvidia Nvidia powers further into the CPU market with new rack systems packing 256 Vera processors Nvidia slaps $20B Groq tech into massive new LPX racks to speed AI response time Any ti… …
… MORE CONTEXT Alibaba has made 470,000 AI chips, admits they're inferior and may always be Decoding Nvidia's Groq-powered LPX and the rest of its new rack systems Meta reveals four Broadcom-built custom AI chips, claims some outperform commercial silicon Nvidia-backed photonics startup Ayar Labs fil… …
… Nvidia has come to dominate the market for the high-speed networks and switches needed to run hundreds of GPUs in concert. The company's kit isn't cheap and doesn't always play nicely with GPUs from other suppliers. …
… After years of GPUs and AI accelerators dominating headlines, CPUs are back in the limelight because those agentic frameworks, tools, API calls, and AI-generated code snippets need to run on something, and it's not GPUs. …