Cloud & Data Platforms
A complete learning journey across fourteen programs, built for someone with real interest but no data background to start from scratch and grow, step by step, toward Principal Engineer or Director of Cloud and Data Platforms. Data engineering and SQL foundations, the three clouds, warehouses and lakehouses, processing and streaming, and the databases.
New to data? Begin with the basics
You do not need a data background to start this journey. Begin with the Data Engineering & Pipelines foundation below, and build the absolute basics, coding and SQL, through these sibling tracks, either first or in parallel. They are the on-ramp to everything here.
From there, the fourteen programs in this track take you the rest of the way. The path-to-Principal section below shows where it all leads.
Fourteen programs, one sequence
The programs are arranged as a path from foundations to platform mastery. Each stage builds on the last, but every program is complete in itself.
Five stages, in order or on demand
The journey moves through five stages. Foundations builds what every cloud-and-data engineer shares: how data moves through modern systems, and fluent SQL across engines. Cloud platforms takes you deep in AWS, Azure, and Google Cloud. Warehouses and lakehouses covers Snowflake and Databricks, the platforms at the center of the modern stack. Processing and streaming covers Spark and Kafka, the engines that move data at scale. And databases covers PostgreSQL, Oracle, SQL Server, and ClickHouse. You can walk the whole path, or step in exactly where your goals sit.
All fourteen, grouped by stage
Foundations
Start here to build the base every cloud-and-data engineer shares: how data moves through modern systems, and fluent SQL across engines.
Cloud platforms
Master the three major clouds, AWS, Azure, and Google Cloud, each from foundations to production data platforms.
Warehouses & lakehouses
The cloud data platforms at the center of the modern stack: Snowflake's data cloud and the Databricks lakehouse for data and AI.
Processing & streaming
The engines that move and transform data at scale: Apache Spark for large-scale processing and Apache Kafka for real-time streaming.
Databases
The databases that store the world's data, from open-source PostgreSQL and real-time ClickHouse to enterprise Oracle and SQL Server.
Specialized & multi-model databases
Beyond the relational and columnar engines in the programs above, the database world spans many specialized families, each suited to a different shape of data and problem. The dedicated program covers 12 of them, each with a distinct enterprise use case and a full twenty-lesson path that builds an end-to-end prototype, 240 lessons and 12 working prototypes in all.
Store data as flexible JSON or BSON documents rather than rows and columns, so each record carries a nested, evolving shape without a fixed schema.
Enterprise use case: a product-catalog and order service for a retailer, where every product has different attributes and orders embed line items, addresses, and status history in one document.
- The document model
- Modeling and querying
- Aggregation and analytics
- Scale, operations, and the prototype
Prototype built across the 20 lessons: a working catalog-and-orders API on a document store, with nested documents, indexes, an aggregation pipeline for reporting, and a sharded, replicated deployment.
Store data as simple key-value pairs for extremely fast reads and writes, trading rich query power for raw speed and predictable low latency.
Enterprise use case: a session store and rate limiter for a high-traffic web platform, where millions of lookups per second must return in well under a millisecond.
- The key-value model
- Access patterns
- Building the rate limiter
- Persistence, scale, and the prototype
Prototype built across the 20 lessons: a session store and rate limiter serving sub-millisecond lookups, with sound key design, expiry, persistence, and a replicated, highly available setup.
Organize data into rows with dynamic, wide sets of columns, optimized for writing and reading enormous volumes across a distributed cluster with no single point of failure.
Enterprise use case: a time-ordered event and messaging store for a large consumer app, ingesting billions of writes per day across many data centers with always-on availability.
- The wide-column model
- Modeling for the cluster
- Consistency and the write path
- Operations, scale, and the prototype
Prototype built across the 20 lessons: a distributed event and messaging store modeled query-first, with a partitioning and clustering design, tunable consistency, and a multi-node cluster handling high write volume.
Store entities as nodes and relationships as edges, making it natural and fast to traverse deep, interconnected relationships that would be costly joins in a relational database.
Enterprise use case: a fraud-detection and recommendation graph for a bank, linking customers, accounts, devices, and transactions to surface rings and suspicious patterns in real time.
- The graph model
- Querying the graph
- Graph algorithms
- Scale, real-time, and the prototype
Prototype built across the 20 lessons: a fraud-detection and recommendation graph modeling customers, accounts, and transactions, running pattern-matching and pathfinding queries to surface suspicious rings.
Optimize for timestamped measurements written in order and queried over time windows, with efficient storage, retention, and downsampling of high-frequency data.
Enterprise use case: an industrial sensor and metrics platform for a manufacturer, ingesting readings from thousands of machines and serving live dashboards and alerts.
- The time-series model
- Ingesting at scale
- Querying over time
- Dashboards, alerts, and the prototype
Prototype built across the 20 lessons: a sensor and metrics platform ingesting high-frequency readings, with time-window aggregations, retention and downsampling, and live dashboards with alerting.
Persist application objects directly, preserving their structure and relationships without an object-relational mapping layer, so complex object graphs are stored and retrieved as-is.
Enterprise use case: a CAD and engineering-model store for a design firm, where deeply nested object structures must be saved and reloaded with full fidelity and no mapping overhead.
- The object database model
- Storing object graphs
- Querying and transactions
- Fit, operations, and the prototype
Prototype built across the 20 lessons: an application that persists and reloads complex nested object graphs directly, with object queries, transactions, and a demonstration of full-fidelity round-tripping.
Store data by column rather than by row, so analytical queries scan only the columns they need and compress heavily, delivering fast aggregations over huge datasets.
Enterprise use case: a business-intelligence warehouse for a retailer, aggregating billions of sales rows into sub-second dashboards across products, regions, and time.
- Columnar foundations
- Modeling for analytics
- Fast aggregation
- Cost, operations, and the prototype
Prototype built across the 20 lessons: a BI warehouse modeling sales data for fast aggregation, with a tuned schema, materialized roll-ups, and sub-second dashboard queries. This family is also covered in depth by the ClickHouse, Snowflake, and cloud-warehouse programs in this track.
Combine the familiar relational model and strong transactional guarantees with the horizontal, distributed scalability usually associated with NoSQL systems.
Enterprise use case: a globally distributed ledger for a payments company, requiring strongly consistent transactions across regions without giving up SQL or ACID.
- The NewSQL model
- Distributed transactions
- Data distribution
- Operations, scale, and the prototype
Prototype built across the 20 lessons: a strongly consistent, multi-region ledger on a distributed SQL engine, with distributed transactions, region-aware data placement, and a resilient cluster.
Keep data primarily in RAM rather than on disk, delivering ultra-low latency for both transactions and analytics where speed matters more than storage cost.
Enterprise use case: a real-time pricing and risk engine for a trading desk, recomputing positions and exposure in memory as market data streams in.
- The in-memory model
- In-memory processing
- Durability and capacity
- Availability and the prototype
Prototype built across the 20 lessons: a real-time pricing and risk engine holding working data in memory, recomputing exposure on streaming input, with a persistence and high-availability strategy.
Store high-dimensional embedding vectors and search them by similarity, powering semantic search, recommendations, and retrieval-augmented generation for AI applications.
Enterprise use case: a semantic search and retrieval layer for a company knowledge base, letting an AI assistant answer questions grounded in the organization's own documents.
- Vectors and embeddings
- Indexing and search
- Retrieval-augmented generation
- Scale, operations, and the prototype
Prototype built across the 20 lessons: a semantic-search layer over a document set, embedding content, indexing it for similarity search, and wiring it into a retrieval-augmented AI assistant.
Index text for fast full-text search, ranking, filtering, and aggregation, so applications can search large document and log collections with relevance scoring and near-real-time results.
Enterprise use case: a product search and log-analytics platform for an online store, powering typo-tolerant product search and real-time operational dashboards over application logs.
- Search foundations
- Querying and relevance
- Aggregations and log analytics
- Scale, operations, and the prototype
Prototype built across the 20 lessons: a search and log-analytics platform with an inverted index, relevance-ranked product search, faceted filtering, and near-real-time log dashboards.
Support several data models, document, graph, key-value, and more, within a single engine, so one system can serve varied workloads without stitching together many databases.
Enterprise use case: a unified customer-360 platform for an enterprise, combining document profiles, a relationship graph, and key-value preferences in one database.
- The multi-model idea
- Documents and key-value
- The relationship graph
- Design, trade-offs, and the prototype
Prototype built across the 20 lessons: a customer-360 platform using document, graph, and key-value models in a single engine, queried together, with a discussion of when this beats specialized stores.
Knowing this landscape, and being able to pick the right database for a given workload, is exactly the breadth that senior and principal platform engineers bring to an architecture decision.
What each program is, in brief
A one-paragraph orientation to each of the fourteen programs and where it sits in the journey, so you can see the whole track at a glance before choosing.
Data Engineering & Pipelines Foundations01 · Foundations
Before any single platform, a data engineer needs the map: how data moves through modern systems, how pipelines are built and orchestrated, and how the pieces, clouds, warehouses, engines, databases, fit together. This program builds that map, and it is the recommended place to start.
In the journey: This is the first program and the map for the whole track. If you are from a non-data background, pair it with the Programming and Data Analytics tracks for coding and SQL. Everything after it, the clouds, warehouses, engines, and databases, slots into the picture this program builds.
SQL - Beginner to Super Advanced02 · Foundations
SQL is the one language that runs through every part of this track, from a first query to distributed SQL across cloud warehouses. This program takes it from the basics to super-advanced, across engines, so it becomes the tool you reach for everywhere.
In the journey: SQL is the second foundation and the skill every later program uses. It pairs naturally with the Data Analytics track's SQL foundation, and it is the language you will write on every cloud, warehouse, and database in this track, all the way up.
AWS - Cloud Mastery03 · Cloud platforms
AWS is the most widely used cloud, and this program takes you from its foundations to production depth: compute, storage, and networking, the data services, and the architecture, security, and DevOps skills that run real platforms on AWS.
In the journey: AWS opens the cloud-platforms stage. Master one cloud deeply first; the concepts, compute, storage, networking, IAM, architecture, transfer to Azure and GCP, and the multi-cloud breadth you build across all three is what senior and principal roles require.
Microsoft Azure - Cloud Mastery04 · Cloud platforms
Microsoft Azure runs a huge share of enterprise systems, and this program takes you from fundamentals to expert depth across infrastructure, data, AI, and DevOps, with the skills that operate enterprise data platforms on Azure.
In the journey: Azure is one of the three clouds in the journey. Many enterprises are Microsoft-centric, so Azure depth is highly employable, and holding it alongside AWS and GCP is the multi-cloud breadth that lead and principal platform roles are built on.
Google Cloud - Cloud Mastery05 · Cloud platforms
Google Cloud is known for data and analytics at scale, and this program takes you from foundational to professional depth across data, AI, DevOps, and architecture, centered on BigQuery and the platform's data strengths.
In the journey: GCP completes the cloud-platforms stage. Its data strengths make it a favorite for analytics work, and together with AWS and Azure it gives you the multi-cloud command that distinguishes senior and principal platform engineers.
Snowflake - Data Cloud Mastery06 · Warehouses & lakehouses
Snowflake is a backbone of the modern data stack, and this program takes you from its architecture to expert use: data engineering, modeling, performance, security, and the multi-cloud integration that makes the Data Cloud so widely adopted.
In the journey: Snowflake opens the warehouses-and-lakehouses stage. It sits at the center of many modern data stacks and integrates across all three clouds, so it complements the cloud-platform programs and is a pillar of the senior data-platform skill set.
Databricks - Lakehouse & AI Mastery07 · Warehouses & lakehouses
Databricks unifies data engineering, machine learning, and AI on one platform, and this program takes you across all three: the lakehouse architecture, Delta Lake, Spark at scale, MLflow, and building generative-AI applications over your own data.
In the journey: Databricks rounds out the warehouses-and-lakehouses stage and reaches into ML and AI. Its Spark foundation connects to the Spark program, and its data-plus-AI breadth is increasingly central to senior and principal data-platform roles.
Apache Spark - Large-Scale Processing Mastery08 · Processing & streaming
Apache Spark is the engine behind large-scale data processing, and this program takes you from its execution model to production: Spark core and SQL, structured streaming, machine learning, and running Spark on Kubernetes and managed cloud services.
In the journey: Spark opens the processing-and-streaming stage and underpins Databricks. Its performance-tuning depth is a hallmark of senior data engineers, and the batch-and-streaming command it builds is central to large-scale platform work.
Apache Kafka - Streaming Platform Mastery09 · Processing & streaming
Apache Kafka is the backbone of real-time data, and this program makes you a production-ready Kafka engineer: producers and consumers, Kafka Streams, Connect, Schema Registry, cluster operations, and the security and observability that keep streams flowing.
In the journey: Kafka completes the processing-and-streaming stage and integrates with Spark, the warehouses, and the databases. Owning real-time infrastructure is a distinctive senior skill, and event-driven architecture is core to the platforms principal engineers design.
PostgreSQL - Database Mastery10 · Databases
PostgreSQL is the default open-source database, and this program takes you from developer to DBA to data engineer: query optimization, administration, performance tuning, replication, and the extension ecosystem that makes Postgres so capable.
In the journey: PostgreSQL opens the databases stage. As the default open-source database it appears in almost every stack, and its optimization and administration skills transfer to the other databases and underpin the whole senior data-platform skill set.
Oracle Database - Enterprise Database Mastery11 · Databases
Oracle Database runs many of the world's largest enterprises, and this program takes you across its full range: Oracle SQL and PL/SQL development, database administration, and the high-availability systems, RAC and Data Guard, that keep mission-critical data running.
In the journey: Oracle sits in the databases stage as the enterprise heavyweight. Its administration and high-availability depth is valued in large organizations, and the mission-critical operations skills it builds are part of the breadth senior and principal engineers carry.
Microsoft SQL Server - Database & BI Mastery12 · Databases
Microsoft SQL Server powers a huge share of enterprise data, and this program covers it end to end: T-SQL development and database design, administration, performance tuning, the BI stack, and integration with Azure SQL and Power BI.
In the journey: SQL Server sits in the databases stage and connects to Azure and Power BI, linking back to the Azure cloud program. Its development, administration, and BI breadth is highly employable in Microsoft-centric enterprises and part of the senior data-platform toolkit.
ClickHouse - Real-Time Analytics Mastery13 · Databases
ClickHouse delivers sub-second analytics at massive scale, and this program takes you from its columnar architecture to distributed cluster administration: OLAP, real-time analytics, and the query optimization that makes ClickHouse extraordinarily fast.
In the journey: ClickHouse completes the core databases stage with real-time OLAP, and it integrates with Kafka from the streaming stage. Sub-second analytics at scale is an increasingly sought capability, rounding out the breadth that senior and principal platform engineers bring.
Specialized & Multi-Model Databases14 · Databases
The database world is far larger than relational and columnar engines. This program surveys twelve specialized and multi-model families, each with a distinct enterprise use case and a full path that builds an end-to-end prototype, so you learn not only how each works but exactly when to reach for it.
In the journey: This program closes the databases stage by going broad rather than deep, complementing the single-engine programs. The ability to choose the right database for a workload is a hallmark of the senior and principal roles the whole track builds toward.
The disciplines the curriculum spans
Across the fourteen programs, the curriculum covers the full cloud-and-data-platform stack, from data engineering and the clouds to warehouses, lakehouses, processing, streaming, and the databases.
Sequenced, but not rigid
The fourteen programs are arranged as a deliberate sequence, but the sequence is a recommendation, not a requirement. Someone new to the field benefits from walking the whole path: the foundations build data engineering and SQL, the cloud programs give real depth in a platform, the warehouse, lakehouse, processing, and streaming programs turn that into the ability to build real data platforms, and the databases round out the picture. Taken together, in order, they build a rounded and cumulative command of cloud and data platforms that no single program provides.
But careers rarely start from the same place. An experienced engineer might skip the foundations and go straight to a cloud or a warehouse; someone focused on real-time data might take Kafka, Spark, and ClickHouse; a database specialist might concentrate on PostgreSQL and Oracle. The sequencing exists so that those who want a path have one, and so that those who know their destination can see exactly how a given program relates to everything around it. Every program is complete in itself, with its own syllabus, worked examples, and project, so entering at any point still gives you a whole, finished program rather than a fragment of a larger one.
What ties the track together is a consistent philosophy rather than a forced dependency. Each program is built around real platforms and real code, extended with worked examples, and anchored by a project you can keep and show. That shared approach means the skills compound naturally when you take more than one, without any program assuming you have taken another, and together they build toward the senior technical-leadership destination the next section lays out.
The path to Principal Engineer / Director
This track is built to carry you the whole way, from a first step with no data background to Principal Engineer or Director of Cloud and Data Platforms. Here is how the levels build.
Begin with the sibling tracks for coding and SQL, then the Data Engineering & Pipelines foundation here.
The foundations, one cloud, a warehouse or lakehouse, and a processing or streaming engine give you a real engineer's toolkit.
Depth across multiple clouds, warehouses, and databases, plus operations, security, and cost, is what senior roles require.
Breadth across the whole stack, with the architecture, reliability, and governance judgment to design platforms others build on.
Mastery across the entire track, plus the architecture, leadership, and cross-domain judgment to own an organization's data platform strategy.
No single program makes you a principal engineer; the destination is reached through breadth across the whole stack combined with the architecture, operations, and leadership judgment that the senior material emphasizes. Each program contributes a real, in-demand piece of that breadth, and the further up the ladder you go, the more the emphasis shifts from building systems to designing them and setting the direction others follow.
Find your starting point
Not sure where to begin? Match your situation to a program. If you are from a non-data background, start with the foundation and the sibling tracks above.
Cumulative by design
The sequence is built so that each stage rests on the one before, from a shared foundation up through the clouds, warehouses, engines, and databases to platform mastery.
Practical, practitioner-built, portfolio-driven
Every program in this track shares a philosophy: learning should translate into capability you can demonstrate. Each is built around real platforms and real code, extended with worked examples that show the method rather than just naming the topic. Each ends with a project or capstone you can keep and show, because the point is not only to know the material but to prove you can apply it.
The programs are also built to fit together. Sequencing them as a journey means the foundation you build in one is assumed and extended by the next, so that a learner who follows the path develops a rounded, cumulative command of cloud and data platforms rather than a collection of disconnected courses. And because every program can be delivered as a private corporate cohort, teams can build the same capability together, aligned to their own data stack and platforms.
Build the capability across your team
Every program can be delivered as a tailored corporate cohort, aligned to your data stack and platforms, whether you are upskilling a data or platform team, onboarding new engineers, or building cloud and data capability toward senior and principal levels.
Scope a corporate engagementFrequently asked questions
What does this track cover?
The full cloud-and-data-platform journey: data engineering and pipelines, SQL across engines, the three major clouds (AWS, Azure, Google Cloud), the warehouses and lakehouses (Snowflake, Databricks), the processing and streaming engines (Spark, Kafka), and the databases (PostgreSQL, Oracle, SQL Server, ClickHouse).
Can I start from scratch with no data background?
Yes. The track is designed to take a motivated beginner from zero to the senior end of the field. Start with Data Engineering & Pipelines Foundations here, and use the sibling Programming and Data Analytics tracks for the coding and SQL basics, either first or in parallel. The start-here section on this page links them.
Where can this track lead?
For those who want it, all the way to Principal Engineer or Director of Cloud and Data Platforms. That destination is reached through breadth across the whole stack plus architecture, operations, and leadership judgment. The path-to-Principal section on this page lays out the career ladder.
In what order should I take the programs?
The programs are sequenced as a journey: the data-engineering and SQL foundations first, then a cloud, then a warehouse or lakehouse, a processing or streaming engine, and the databases. You can follow that order or enter wherever your goals fit. The how-to-choose guide on this page helps you decide.
Which cloud should I learn first?
Master one deeply first; the concepts transfer. AWS is the most widely used, Azure suits Microsoft-centric enterprises, and Google Cloud is strong for analytics. Breadth across all three is what senior and principal platform roles are built on.
Do I need the sibling tracks?
If you are new to coding or SQL, yes, as a prerequisite or parallel study: the Programming track builds Python and tooling, and the Data Analytics track builds SQL and data foundations. If you already have those, you can start directly in this track.
Are the programs self-paced or cohort-based?
Both, depending on the program. Most are available self-paced with hands-on labs, and mentor-led cohorts and private corporate delivery are available across the track.
Are the programs hands-on?
Yes. Every program is project-driven, with worked examples and code throughout and a portfolio-ready capstone, from a production data platform on a cloud to a tuned Spark job, a Kafka streaming system, or a real-time ClickHouse cluster.
Can my organization run these as private cohorts?
Yes. Every program can be delivered as a tailored corporate cohort, aligned to your data stack and platforms. Contact us to scope it.
Do you offer a brochure?
Yes. A downloadable PDF brochure summarizing the programs is available from the button at the top of the page.