Learning Data

Topics › Analytics engineering › In the weeds of data crafting

Built in layers: one job per layer, one step per CTE

The tests are written, and they wait for code. Like the stations of Escoffier's kitchen, each layer of Jun's project does one job: staging tidies a table, intermediate holds the steps, the core holds what the blueprint names, and each mart serves one consumer. Inside a model, each CTE is one step.

4½ min4 labs8 scenariosPause and thinkEnglish captions

Builds on Promises and proofs

Watch the film

Press Play, or pick a chapter. Turn on Pause and think to stop for one question at the end of chapters.

0:00

See it in the project

Every card in the film shows a real file from the example dbt project. Open the ones each chapter shows, on GitHub, or run the whole project yourself.

Think it through

The four Pause and think questions, for a class or a team. Open one to see the answer.

In the series: In the weeds of data crafting

Film 6 of 10.

← Previous · Film 5 of 10

Promises and proofs

Every gap gets a decision. Promise it in a contract; prove it with a test, written before the code it checks.

5½ min · 4 labs · 8 scenarios · In the weeds of data crafting

Next · Film 7 of 10 →

Who owns what

Each fact's meaning has an owner. Owners publish a public, versioned core; consumers build on it, never on each other's marts.

5½ min · 4 labs · 8 scenarios · In the weeds of data crafting

  1. 1Declare it, then build it
  2. 2Start from a question
  3. 3What makes it the same one
  4. 4One row of what, and when
  5. 5Promises and proofs
  6. 6Built in layers
  7. 7Who owns what
  8. 8An agent on the team
  9. 9Written once
  10. 10End to end