Networking & Interconnect
How chips and sites talk to each other.
Fourth-generation NVLink bandwidth per H100 GPU — what one accelerator can say to its neighbours
In scope: optical interconnect and co-packaged optics, scale-up versus scale-out fabrics, NVLink, InfiniBand and Ethernet economics, bandwidth per dollar, topology, cross-datacenter links. Out: memory bandwidth inside a package (hardware), photonic compute (out of the knowledge base entirely).
This rung has no compiled overview yet. Until it does, the base is best read across the stack rather than down one rung.
Start here
- 01LLM Inference Prices Have Fallen Rapidly but Unequally Across Tasks
Start at the number the whole base chases: what a token costs, and how unevenly that price has actually fallen.
inference-economics - 02Memory-Centric Computing: A Paradigm Shift for Sustainable and Efficient Systems
The reason the price falls the way it does — the bottleneck is moving data, not doing arithmetic on it.
hardware - 03AI Hyperscaler Capex 2026: Why Microsoft, Google, Meta and Amazon Are All Spending at Once
Where the money physically lands once the bottleneck is priced: buildings, land and power, committed years ahead.
datacenters - 04Speculative Decoding Meets Quantization: Compatibility Evaluation and Hierarchical Framework Design
How the cost is actually cut in software, and what the two cheapest tricks do to each other when you stack them.
serving - 05Agentic Reasoning for Large Language Models
The demand side: the systems wrapped around the model are what decide how many tokens the price applies to.
harnesses
Companies on this rung
All 23 →- Accelink Technologies
- Arista Networks
- Astera Labs
- AXT Inc
- Ayar Labs
Replacing copper with light. One chiplet at a time.
- Celestial AI
- Coherent Corp
- Credo Technology
- Enablence Technologies
- Eoptolink Technology
- Fabrinet
- HyperLight