1 article
How NVIDIA SHARP moves all-reduce math into NVSwitch and InfiniBand switches: ring vs in-network data movement, generations, NCCL flags and caveats.