NVIDIA NVbandwidth: Your Essential Tool for Measuring GPU Interconnect and Memory Performance | NVIDIA Technical Blog
…Host -> Device (H2D) Device -> Host (D2H) Device ↔ Device (D2D) Bidirectional tests: Host ↔ Device Device ↔ Device Multi-GPU tests: All to One (A2O) One to All (O2A) All to Host (A2H) Host to…