Skip to content
Rung 03 ModelsSwitch rung
Rung 03 / What the model can do, per token

Models

What the model can do, and what that costs per token.

16
Sources
6
Concepts
6
Entities
A machined steel model block on a copper base, on paper.

In scope: quantization, mixture-of-experts, distillation, context handling, evals — and the specific-and-local cluster: fine-tuning, personalisation, open-weight releases, and running models on your own compute. Out: general AI research that moves neither cost nor capability per token, and the system around the model, which lives in harnesses.

Eight expert blocks under a router bar, with only two lit in copper — sparse activation.
QuantizationMoEDistillationFine-tuningOpen-weight