Rung 05 / How chips and sites talk

Networking & Interconnect

How chips and sites talk to each other.

900 GB/s

Fourth-generation NVLink bandwidth per H100 GPU — what one accelerator can say to its neighbours

4
Sources
1
Concepts
1
Entities
Paper2ReportAnalysisNews2
A brushed steel fibre coupler with copper collars, on paper.

In scope: optical interconnect and co-packaged optics, scale-up versus scale-out fabrics, NVLink, InfiniBand and Ethernet economics, bandwidth per dollar, topology, cross-datacenter links. Out: memory bandwidth inside a package (hardware), photonic compute (out of the knowledge base entirely).

A cable bundle of copper conductor and glass fibre terminating in one cartridge.
Optical interconnectCPOFabricsTopology
Networking & Interconnect | Knowledge Base | MenFem