Students Professional
JA EN

#collective-communication

1 articles

01 ·Computer Architecture·★ MEMBER·9 min read Interconnects — How NVLink, PCIe, and Light Set the Limits of Scale When adding GPUs stops making things faster, the wiring is usually to blame. This piece pins down the bandwidth hierarchy from HBM through NVLink, PCIe, and the inter-node fabric, breaks collective time into 'steps × latency + bytes ÷ bandwidth', and explains why all-to-all hurts and why distance eventually demands light.