Data Engineering & Pipelines Foundations
The foundation that ties the whole track together: how data moves through modern systems, ETL and ELT, orchestration, data modeling, and the role of the data engineer, before you specialize in any single platform.
Every AWS credential, and where to start
Full track
Foundational
Associate
Professional
The full syllabus
Four modules of five chapters each, sequenced so the material builds cumulatively. The brochure carries a note on what each chapter teaches.
M1 How data moves Ch 1-5 · 5 chapters
- What a data engineer does and why it matters
- Sources, sinks, and the shape of a pipeline
- Batch versus streaming, and when to use each
- The modern data stack, from a height
- Where cloud, warehouses, and processing fit
M2 ETL and ELT Ch 6-10 · 5 chapters
- Extract, transform, load, and the ELT shift
- Ingestion patterns and change data capture
- Transformation and the role of SQL
- Data quality, validation, and testing
- Idempotency and safe reprocessing
M3 Data modeling for pipelines Ch 11-15 · 5 chapters
- Relational modeling and normalization
- Dimensional modeling for analytics
- The medallion (bronze, silver, gold) pattern
- Schema evolution and contracts
- Partitioning and file formats
M4 Orchestration and reliability Ch 16-20 · 5 chapters
- Orchestration and scheduling
- DAGs and dependency management
- Idempotent, retryable tasks
- Monitoring, alerting, and observability
- The end-to-end pipeline project
Frequently asked questions
What is the Data Engineering & Pipelines Foundations programme?
The foundation that ties the whole track together: how data moves through modern systems, ETL and ELT, orchestration, data modeling, and the role of the data engineer, before you specialize in any single platform.
Who is this programme for?
It suits newcomers building a base before choosing a platform, along with others described on this page.
How is it delivered?
Self-paced with hands-on labs; the recommended starting point and the map for the whole track.
Is there a project or capstone?
Build an end-to-end data pipeline from scratch: ingest from a source, transform through a medallion (bronze, silver, gold) layout, model the result for analytics, orchestrate it as a scheduled, retryable, monitored job, and document it as the reference project the rest of the track builds on.
How does this fit the wider journey?
This is the first programme and the map for the whole track. If you are from a non-data background, pair it with the Programming and Data Analytics tracks for coding and SQL. Everything after it, the clouds, warehouses, engines, and databases, slots into the picture this programme builds.
Can my organization run this as a private cohort?
Yes. Every programme can be delivered as a tailored corporate cohort. Contact us to scope it.