Skip to content
Rung 05 DataSwitch rung
Rung 05 / What it learns from

Data

What the model is trained and grounded on, and what that constrains.

3
Sources
3
Concepts
4
Entities
A stack of polished steel drive platters on a copper spindle, on paper.

In scope: training-data supply and exhaustion, synthetic data, licensing and provenance, retrieval corpora, data quality effects on capability per token, contamination. Out: retrieval as a harness mechanism (harnesses), model architecture (models).

A banded drill core in a tray, the thin copper band marking the clean licensed seam.
SyntheticLicensingProvenanceExhaustion
Download Report
AnthropiclabThe Authors GuildorganizationEpoch AIorganizationRedditcompany