As clusters grow in scale and complexity, managing GPU resources becomes critical for achieving both high utilization and predictable performance. The GB200 NVL72 system introduces larger AI job segment sizes and fine-grained scheduling control, enabling operators to align segment configurations with workload needs. Together with GB200 NVL72-aware scheduling extensions in the Slurm workload manager, this approach balances large and small jobs to maximize efficiency even in the presence of hardware faults.
Unlock Exascale Performance on NVIDIA GB200 NVL72 with Slurm Topology-Aware Job Scheduling | NVIDIA Technical BlogNVIDIA GB200 NVL72 is an exascale computer in a single rack. With 72 NVIDIA Blackwell GPUs interconnected by the largest production scale-up compute fabric, NVIDIA NVLink provides 130 terabytes per second (TB/s) of low-latency GPU communication bandwidth for AI and high-performance computing (HPC) workloads. Multiple GB200 NVL72 systems combined in a cluster create hierarchical network topology with large domains of very high networking bandwidth. An AI training job can greatly benefit from the abundant networking bandwidth offered by GB200 NVL72, when scheduled to maximize the use of NVLink
Unlock Exascale Performance on NVIDIA GB200 NVL72 with Slurm Topology-Aware Job Scheduling | NVIDIA Technical Blog…Nsight Systems visualizes unbiased, system-wide activity data on a unified timeline, allowing application developers to investigate correlations, dependencies, activity, bottlenecks, and resource allocation to ensure hardware components are working harmoniously. Analyze…
…More than a few HPC clusters that have CPU-only codes use Grace CPUs for a big portion of their hardware. The latest “Isambard” machine at the University of Bristol and the…
…of 20 percent of the total cost of acquisition for AI cluster hardware. Hyperscalers and cloud builders, not to mention HPC centers, do not like when networking represents more than 10 percent…
…networks for AI clusters, and maybe HPC clusters, too. Arista Networks will get its fair share of scale out networks to link traditional server nodes into racks and clusters as well as…
…View all posts by Sirshak Das View all posts by Sirshak Das About Jill Foster Jill Foster is a senior AI-HPC cluster engineer at NVIDIA, working in the Managed AI Research…
…enable immediate failover in the event of hardware failure, thereby significantly reducing downtime. We see top GPU clouds leverage specialized deployment teams for cluster burn-in and deployment. These teams will integrate…
…3 Technology Highlights Training foundation models requires massive clusters that operate in lockstep. The hardware configuration used a large AI cluster based on 3rd Gen Intel Xeon processors and Intel Gaudi 2…
…A consortium of leading academic HPC centers in Germany will lead this effort. It said its work would allow orgs to "scale AI initiatives" while "adhering to regional data sovereignty and compliance…
…Being able to design, test, and optimize systems before deploying hardware enables every layer of the AI factory to function as a unified, optimized system, preventing major delays or performance issues related…
…On the hardware level, ASUS servers feature Thermal Radar 2.0, which uses up to 56 sensors to intelligently optimize fan performance, cutting power consumption by up to 36% and saving approximately…