Data / Accelerators

How fast the chips actually serve a model.

How fast a system serves Llama 2 70Bwe gathered it
not fetched yet
Range
1mneeds rows3mneeds rows1yneeds rowsall

Nothing has landed here yet.

How fast a system serves Llama 2 70B
not fetched yet
we gathered itall
00111

MLCommons · biannual

Last observations

0 of 0

Nothing has landed here yet.

What is coming

the next 30 days on this beat
  • 2026-09-30Micron

    FY26-Q4 numbers

  • 2026-10-07Penguin Solutions

    2026-Q3 numbers

  • 2026-10-08TSMC

    2026-M10 numbers

Where it comes from

the sources and this month's misses
The sources behind this tracker
SourceCadenceRows this monthLast fetchMisses
MLCommonsclaimed-vs-delivered throughput per vendorbiannual00

Take it with you