Levels you can observe
A pragmatic ladder
Inspired by Google's three-level model (MLOps 0/1/2) and Microsoft's five-level one. Mapped to what learners can observe, not vendor jargon:
| Level | What it looks like | Cost of a model change |
|---|---|---|
| 0 — Notebook hero | Single data scientist, manual deploy, no tracking. | Days to weeks, often impossible to reproduce. |
| 1 — Reproducible | Tracked experiments, registered models, manual promotion. | Hours, reproducible. |
| 2 — Automated training | CI runs train + eval on PR; promotion gated by metric thresholds. | Minutes, automated. |
| 3 — Continuous delivery | Canary + rollback on every deploy; data + model contracts tested. | Minutes, safely reversible. |
| 4 — Continuous learning | Retraining triggered by drift signals; humans approve, system executes. | Hands-off the happy path. |
Pick the next level, not the most fashionable one. Jumping from level 0 to level 4 usually fails — and is rarely needed.