Skip to content
ACD-220 · Ingestia DataPreview

Pipelines and the Bronze/Silver/Gold medallion

Course ACD-220 of the Ingestia Academy — 12 lessons, 6 h of work.

Level
Intermediate
Estimated load
6 h of dedication
Video
12 lessons · 36 min of video

Lessons

  1. Connections, Data, Load, Transformations, Operation, ReviewBuild a pipeline up to Review8 minOperatePreviewvideo in production
  2. Load modes: full, by period and by watermark; replace or appendChoose the mode by its effect on the destination8 minOperatePreviewvideo in production
  3. Source → Bronze → Silver → Gold → publishRun a full pipeline end to end9 minOperatePreviewvideo in production
  4. Incremental by watermark — it is not CDCConfigure watermark + key; validate identity against the full load10 minOperatePreviewvideo in production
  5. History and resuming without duplicatingRun a backfill with checkpoint7 minOperatePreviewvideo in production
  6. The raw layer is never lost: technical columns, partitioning, clustering, PIIConfigure partitioning/clustering and flag PII7 minOperatePreviewvideo in production
  7. Quality rules, deduplication, rejected rowsCreate validation and read rejected rows8 minOperatePreviewvideo in production
  8. pt-BR steps compiled into deterministic SQLCompose the substituir/texto/datas/dividir/condicional steps9 minOperatePreviewvideo in production
  9. Aggregation and visual joinsBuild an aggregated Gold without fan-out8 minOperatePreviewvideo in production
  10. The mart does not break in silenceDiagnose drift and apply sanitization6 minOperatePreviewvideo in production
  11. v2 over a live pipeline, shadow run, rollbackPublish v2 without turning off the schedule; read the diff8 minOperatePreviewvideo in production
  12. Cost engine and the billable-bytes capEstimate GB/month and configure limits6 minOperatePreviewvideo in production

How this course is graded#

Every lesson has a quick check (2 to 3 questions, graded on the server). The course counts as completed when every lesson is completed. The credentials this course feeds require, besides the courses, the exam and the hands-on challenge described on the certification page.

After this course