Peak Training: Blackwell Delivers Next-Level MLPerf Training Performance
… Blackwell’s higher per-GPU compute throughput and significantly larger and faster high-bandwidth memory allows it to run the GPT-3 175B benchmark on fewer GPUs while achieving excellent per-GPU performance. …