← Study
Rung 4 · Gated

CS336 — Language Models from Scratch

StanfordfreeSource ↗

Building the thing comes after understanding the machine it runs on. The assignments are the point — the credibility here is a working model, not a completed lecture list.

0 / 19 lectures
Progress
Allocated
Quota
Read it
Seat
Gated
State

Takes the technical slot when rung 3 closes.

Gate

Follows rung 3. A PyTorch readiness check precedes Assignment 1; if fluency is thin, a nanoGPT warm-up comes first.

Inference Engineering →

Artifacts

Consume → do → output
NBNotebookLABLabGMEGameBTLBottle0/2
  • I built a language model from scratch — the build, in publicNot yet — nothing has landed for this slot.
  • The from-scratch model, runningNot yet — nothing has landed for this slot.

Feeds

What closing this sharpens
Models →

The reading

Sections of the catalogue this unit draws on
  • §1Architecture and Model Design22 papersModels
  • §2Efficient Training and Scaling15 papersModels · Data

The papers

The rows behind the sections above

§1 · Architecture and Model Design

22 papers · ★1 · 0 in the AtlasSection page →