Cloud & Data Platforms · 14 programs · 280 chapters

Cloud & Data Platforms

5,080 words23 min read

A complete learning journey across fourteen programs, built for someone with real interest but no data background to start from scratch and grow, step by step, toward Principal Engineer or Director of Cloud and Data Platforms. Data engineering and SQL foundations, the three clouds, warehouses and lakehouses, processing and streaming, and the databases.

Start from scratch
Start here

New to data? Begin with the basics

You do not need a data background to start this journey. Begin with the Data Engineering & Pipelines foundation below, and build the absolute basics, coding and SQL, through these sibling tracks, either first or in parallel. They are the on-ramp to everything here.

From there, the fourteen programs in this track take you the rest of the way. The path-to-Principal section below shows where it all leads.

The journey

Fourteen programs, one sequence

The programs are arranged as a path from foundations to platform mastery. Each stage builds on the last, but every program is complete in itself.

Fourteen programs, from foundations to platform mastery1FOUNDATIONSData Engineering &Pipelines Foundations2FOUNDATIONSSQL - Beginner toSuper Advanced3CLOUD PLATFORMSAWS - Cloud Mastery4CLOUD PLATFORMSMicrosoft Azure -Cloud Mastery5CLOUD PLATFORMSGoogle Cloud - CloudMastery6WAREHOUSES & LAKEHOUSESSnowflake - Data CloudMastery7WAREHOUSES & LAKEHOUSESDatabricks - Lakehouse& AI Mastery8PROCESSING & STREAMINGApache Spark -Large-Scale ProcessingMastery9PROCESSING & STREAMINGApache Kafka -Streaming PlatformMastery10DATABASESPostgreSQL - DatabaseMastery11DATABASESOracle Database -Enterprise DatabaseMastery12DATABASESMicrosoft SQL Server -Database & BI Mastery13DATABASESClickHouse - Real-TimeAnalytics Mastery14DATABASESSpecialized &Multi-Model Databases
The pathway

Five stages, in order or on demand

A pathway from foundations to platform masteryFoundations2 programsCloud platforms3 programsWarehouses & lakehouses2 programsProcessing & streaming2 programsDatabases5 programs

The journey moves through five stages. Foundations builds what every cloud-and-data engineer shares: how data moves through modern systems, and fluent SQL across engines. Cloud platforms takes you deep in AWS, Azure, and Google Cloud. Warehouses and lakehouses covers Snowflake and Databricks, the platforms at the center of the modern stack. Processing and streaming covers Spark and Kafka, the engines that move data at scale. And databases covers PostgreSQL, Oracle, SQL Server, and ClickHouse. You can walk the whole path, or step in exactly where your goals sit.

The programs

All fourteen, grouped by stage

Databases · going broader

Specialized & multi-model databases

Beyond the relational and columnar engines in the programs above, the database world spans many specialized families, each suited to a different shape of data and problem. The dedicated program covers 12 of them, each with a distinct enterprise use case and a full twenty-lesson path that builds an end-to-end prototype, 240 lessons and 12 working prototypes in all.

Document DatabasesJSON / BSON documents
MongoDB, Couchbase

Store data as flexible JSON or BSON documents rather than rows and columns, so each record carries a nested, evolving shape without a fixed schema.

Enterprise use case: a product-catalog and order service for a retailer, where every product has different attributes and orders embed line items, addresses, and status history in one document.

  • The document model
  • Modeling and querying
  • Aggregation and analytics
  • Scale, operations, and the prototype

Prototype built across the 20 lessons: a working catalog-and-orders API on a document store, with nested documents, indexes, an aggregation pipeline for reporting, and a sharded, replicated deployment.

Key-Value DatabasesFast key-value lookups
Redis, Amazon DynamoDB

Store data as simple key-value pairs for extremely fast reads and writes, trading rich query power for raw speed and predictable low latency.

Enterprise use case: a session store and rate limiter for a high-traffic web platform, where millions of lookups per second must return in well under a millisecond.

  • The key-value model
  • Access patterns
  • Building the rate limiter
  • Persistence, scale, and the prototype

Prototype built across the 20 lessons: a session store and rate limiter serving sub-millisecond lookups, with sound key design, expiry, persistence, and a replicated, highly available setup.

Wide-Column DatabasesMassive-scale distributed data
Apache Cassandra, Apache HBase

Organize data into rows with dynamic, wide sets of columns, optimized for writing and reading enormous volumes across a distributed cluster with no single point of failure.

Enterprise use case: a time-ordered event and messaging store for a large consumer app, ingesting billions of writes per day across many data centers with always-on availability.

  • The wide-column model
  • Modeling for the cluster
  • Consistency and the write path
  • Operations, scale, and the prototype

Prototype built across the 20 lessons: a distributed event and messaging store modeled query-first, with a partitioning and clustering design, tunable consistency, and a multi-node cluster handling high write volume.

Graph DatabasesNodes and relationships
Neo4j, Amazon Neptune

Store entities as nodes and relationships as edges, making it natural and fast to traverse deep, interconnected relationships that would be costly joins in a relational database.

Enterprise use case: a fraud-detection and recommendation graph for a bank, linking customers, accounts, devices, and transactions to surface rings and suspicious patterns in real time.

  • The graph model
  • Querying the graph
  • Graph algorithms
  • Scale, real-time, and the prototype

Prototype built across the 20 lessons: a fraud-detection and recommendation graph modeling customers, accounts, and transactions, running pattern-matching and pathfinding queries to surface suspicious rings.

Time-Series DatabasesTimestamped data
InfluxDB, TimescaleDB

Optimize for timestamped measurements written in order and queried over time windows, with efficient storage, retention, and downsampling of high-frequency data.

Enterprise use case: an industrial sensor and metrics platform for a manufacturer, ingesting readings from thousands of machines and serving live dashboards and alerts.

  • The time-series model
  • Ingesting at scale
  • Querying over time
  • Dashboards, alerts, and the prototype

Prototype built across the 20 lessons: a sensor and metrics platform ingesting high-frequency readings, with time-window aggregations, retention and downsampling, and live dashboards with alerting.

Object-Oriented DatabasesStore objects directly
ObjectDB, db4o

Persist application objects directly, preserving their structure and relationships without an object-relational mapping layer, so complex object graphs are stored and retrieved as-is.

Enterprise use case: a CAD and engineering-model store for a design firm, where deeply nested object structures must be saved and reloaded with full fidelity and no mapping overhead.

  • The object database model
  • Storing object graphs
  • Querying and transactions
  • Fit, operations, and the prototype

Prototype built across the 20 lessons: an application that persists and reloads complex nested object graphs directly, with object queries, transactions, and a demonstration of full-fidelity round-tripping.

Columnar (Analytical) DatabasesAnalytics and reporting
ClickHouse, Amazon Redshift, Snowflake

Store data by column rather than by row, so analytical queries scan only the columns they need and compress heavily, delivering fast aggregations over huge datasets.

Enterprise use case: a business-intelligence warehouse for a retailer, aggregating billions of sales rows into sub-second dashboards across products, regions, and time.

  • Columnar foundations
  • Modeling for analytics
  • Fast aggregation
  • Cost, operations, and the prototype

Prototype built across the 20 lessons: a BI warehouse modeling sales data for fast aggregation, with a tuned schema, materialized roll-ups, and sub-second dashboard queries. This family is also covered in depth by the ClickHouse, Snowflake, and cloud-warehouse programs in this track.

NewSQL DatabasesDistributed SQL at scale
CockroachDB, Google Cloud Spanner

Combine the familiar relational model and strong transactional guarantees with the horizontal, distributed scalability usually associated with NoSQL systems.

Enterprise use case: a globally distributed ledger for a payments company, requiring strongly consistent transactions across regions without giving up SQL or ACID.

  • The NewSQL model
  • Distributed transactions
  • Data distribution
  • Operations, scale, and the prototype

Prototype built across the 20 lessons: a strongly consistent, multi-region ledger on a distributed SQL engine, with distributed transactions, region-aware data placement, and a resilient cluster.

In-Memory DatabasesRAM for ultra-low latency
SAP HANA, Redis

Keep data primarily in RAM rather than on disk, delivering ultra-low latency for both transactions and analytics where speed matters more than storage cost.

Enterprise use case: a real-time pricing and risk engine for a trading desk, recomputing positions and exposure in memory as market data streams in.

  • The in-memory model
  • In-memory processing
  • Durability and capacity
  • Availability and the prototype

Prototype built across the 20 lessons: a real-time pricing and risk engine holding working data in memory, recomputing exposure on streaming input, with a persistence and high-availability strategy.

Vector DatabasesEmbeddings for AI search
Milvus, Pinecone, Weaviate

Store high-dimensional embedding vectors and search them by similarity, powering semantic search, recommendations, and retrieval-augmented generation for AI applications.

Enterprise use case: a semantic search and retrieval layer for a company knowledge base, letting an AI assistant answer questions grounded in the organization's own documents.

  • Vectors and embeddings
  • Indexing and search
  • Retrieval-augmented generation
  • Scale, operations, and the prototype

Prototype built across the 20 lessons: a semantic-search layer over a document set, embedding content, indexing it for similarity search, and wiring it into a retrieval-augmented AI assistant.

Search DatabasesFull-text search and relevance
Elasticsearch, OpenSearch

Index text for fast full-text search, ranking, filtering, and aggregation, so applications can search large document and log collections with relevance scoring and near-real-time results.

Enterprise use case: a product search and log-analytics platform for an online store, powering typo-tolerant product search and real-time operational dashboards over application logs.

  • Search foundations
  • Querying and relevance
  • Aggregations and log analytics
  • Scale, operations, and the prototype

Prototype built across the 20 lessons: a search and log-analytics platform with an inverted index, relevance-ranked product search, faceted filtering, and near-real-time log dashboards.

Multi-Model DatabasesMany models, one system
ArangoDB, Azure Cosmos DB

Support several data models, document, graph, key-value, and more, within a single engine, so one system can serve varied workloads without stitching together many databases.

Enterprise use case: a unified customer-360 platform for an enterprise, combining document profiles, a relationship graph, and key-value preferences in one database.

  • The multi-model idea
  • Documents and key-value
  • The relationship graph
  • Design, trade-offs, and the prototype

Prototype built across the 20 lessons: a customer-360 platform using document, graph, and key-value models in a single engine, queried together, with a discussion of when this beats specialized stores.

Knowing this landscape, and being able to pick the right database for a given workload, is exactly the breadth that senior and principal platform engineers bring to an architecture decision.

Program by program

What each program is, in brief

A one-paragraph orientation to each of the fourteen programs and where it sits in the journey, so you can see the whole track at a glance before choosing.

Data Engineering & Pipelines Foundations01 · Foundations

Before any single platform, a data engineer needs the map: how data moves through modern systems, how pipelines are built and orchestrated, and how the pieces, clouds, warehouses, engines, databases, fit together. This program builds that map, and it is the recommended place to start.

In the journey: This is the first program and the map for the whole track. If you are from a non-data background, pair it with the Programming and Data Analytics tracks for coding and SQL. Everything after it, the clouds, warehouses, engines, and databases, slots into the picture this program builds.

SQL - Beginner to Super Advanced02 · Foundations

SQL is the one language that runs through every part of this track, from a first query to distributed SQL across cloud warehouses. This program takes it from the basics to super-advanced, across engines, so it becomes the tool you reach for everywhere.

In the journey: SQL is the second foundation and the skill every later program uses. It pairs naturally with the Data Analytics track's SQL foundation, and it is the language you will write on every cloud, warehouse, and database in this track, all the way up.

AWS - Cloud Mastery03 · Cloud platforms

AWS is the most widely used cloud, and this program takes you from its foundations to production depth: compute, storage, and networking, the data services, and the architecture, security, and DevOps skills that run real platforms on AWS.

In the journey: AWS opens the cloud-platforms stage. Master one cloud deeply first; the concepts, compute, storage, networking, IAM, architecture, transfer to Azure and GCP, and the multi-cloud breadth you build across all three is what senior and principal roles require.

Microsoft Azure - Cloud Mastery04 · Cloud platforms

Microsoft Azure runs a huge share of enterprise systems, and this program takes you from fundamentals to expert depth across infrastructure, data, AI, and DevOps, with the skills that operate enterprise data platforms on Azure.

In the journey: Azure is one of the three clouds in the journey. Many enterprises are Microsoft-centric, so Azure depth is highly employable, and holding it alongside AWS and GCP is the multi-cloud breadth that lead and principal platform roles are built on.

Google Cloud - Cloud Mastery05 · Cloud platforms

Google Cloud is known for data and analytics at scale, and this program takes you from foundational to professional depth across data, AI, DevOps, and architecture, centered on BigQuery and the platform's data strengths.

In the journey: GCP completes the cloud-platforms stage. Its data strengths make it a favorite for analytics work, and together with AWS and Azure it gives you the multi-cloud command that distinguishes senior and principal platform engineers.

Snowflake - Data Cloud Mastery06 · Warehouses & lakehouses

Snowflake is a backbone of the modern data stack, and this program takes you from its architecture to expert use: data engineering, modeling, performance, security, and the multi-cloud integration that makes the Data Cloud so widely adopted.

In the journey: Snowflake opens the warehouses-and-lakehouses stage. It sits at the center of many modern data stacks and integrates across all three clouds, so it complements the cloud-platform programs and is a pillar of the senior data-platform skill set.

Databricks - Lakehouse & AI Mastery07 · Warehouses & lakehouses

Databricks unifies data engineering, machine learning, and AI on one platform, and this program takes you across all three: the lakehouse architecture, Delta Lake, Spark at scale, MLflow, and building generative-AI applications over your own data.

In the journey: Databricks rounds out the warehouses-and-lakehouses stage and reaches into ML and AI. Its Spark foundation connects to the Spark program, and its data-plus-AI breadth is increasingly central to senior and principal data-platform roles.

Apache Spark - Large-Scale Processing Mastery08 · Processing & streaming

Apache Spark is the engine behind large-scale data processing, and this program takes you from its execution model to production: Spark core and SQL, structured streaming, machine learning, and running Spark on Kubernetes and managed cloud services.

In the journey: Spark opens the processing-and-streaming stage and underpins Databricks. Its performance-tuning depth is a hallmark of senior data engineers, and the batch-and-streaming command it builds is central to large-scale platform work.

Apache Kafka - Streaming Platform Mastery09 · Processing & streaming

Apache Kafka is the backbone of real-time data, and this program makes you a production-ready Kafka engineer: producers and consumers, Kafka Streams, Connect, Schema Registry, cluster operations, and the security and observability that keep streams flowing.

In the journey: Kafka completes the processing-and-streaming stage and integrates with Spark, the warehouses, and the databases. Owning real-time infrastructure is a distinctive senior skill, and event-driven architecture is core to the platforms principal engineers design.

PostgreSQL - Database Mastery10 · Databases

PostgreSQL is the default open-source database, and this program takes you from developer to DBA to data engineer: query optimization, administration, performance tuning, replication, and the extension ecosystem that makes Postgres so capable.

In the journey: PostgreSQL opens the databases stage. As the default open-source database it appears in almost every stack, and its optimization and administration skills transfer to the other databases and underpin the whole senior data-platform skill set.

Oracle Database - Enterprise Database Mastery11 · Databases

Oracle Database runs many of the world's largest enterprises, and this program takes you across its full range: Oracle SQL and PL/SQL development, database administration, and the high-availability systems, RAC and Data Guard, that keep mission-critical data running.

In the journey: Oracle sits in the databases stage as the enterprise heavyweight. Its administration and high-availability depth is valued in large organizations, and the mission-critical operations skills it builds are part of the breadth senior and principal engineers carry.

Microsoft SQL Server - Database & BI Mastery12 · Databases

Microsoft SQL Server powers a huge share of enterprise data, and this program covers it end to end: T-SQL development and database design, administration, performance tuning, the BI stack, and integration with Azure SQL and Power BI.

In the journey: SQL Server sits in the databases stage and connects to Azure and Power BI, linking back to the Azure cloud program. Its development, administration, and BI breadth is highly employable in Microsoft-centric enterprises and part of the senior data-platform toolkit.

ClickHouse - Real-Time Analytics Mastery13 · Databases

ClickHouse delivers sub-second analytics at massive scale, and this program takes you from its columnar architecture to distributed cluster administration: OLAP, real-time analytics, and the query optimization that makes ClickHouse extraordinarily fast.

In the journey: ClickHouse completes the core databases stage with real-time OLAP, and it integrates with Kafka from the streaming stage. Sub-second analytics at scale is an increasingly sought capability, rounding out the breadth that senior and principal platform engineers bring.

Specialized & Multi-Model Databases14 · Databases

The database world is far larger than relational and columnar engines. This program surveys twelve specialized and multi-model families, each with a distinct enterprise use case and a full path that builds an end-to-end prototype, so you learn not only how each works but exactly when to reach for it.

In the journey: This program closes the databases stage by going broad rather than deep, complementing the single-engine programs. The ability to choose the right database for a workload is a hallmark of the senior and principal roles the whole track builds toward.

One stack, every discipline

The disciplines the curriculum spans

Across the fourteen programs, the curriculum covers the full cloud-and-data-platform stack, from data engineering and the clouds to warehouses, lakehouses, processing, streaming, and the databases.

One track spanning the cloud and data platform stackData engineeringCloud platformsData warehousesLakehousesBatch processingStreamingDatabasesArchitecture & scaleData &Analytics
How the journey works

Sequenced, but not rigid

The fourteen programs are arranged as a deliberate sequence, but the sequence is a recommendation, not a requirement. Someone new to the field benefits from walking the whole path: the foundations build data engineering and SQL, the cloud programs give real depth in a platform, the warehouse, lakehouse, processing, and streaming programs turn that into the ability to build real data platforms, and the databases round out the picture. Taken together, in order, they build a rounded and cumulative command of cloud and data platforms that no single program provides.

But careers rarely start from the same place. An experienced engineer might skip the foundations and go straight to a cloud or a warehouse; someone focused on real-time data might take Kafka, Spark, and ClickHouse; a database specialist might concentrate on PostgreSQL and Oracle. The sequencing exists so that those who want a path have one, and so that those who know their destination can see exactly how a given program relates to everything around it. Every program is complete in itself, with its own syllabus, worked examples, and project, so entering at any point still gives you a whole, finished program rather than a fragment of a larger one.

What ties the track together is a consistent philosophy rather than a forced dependency. Each program is built around real platforms and real code, extended with worked examples, and anchored by a project you can keep and show. That shared approach means the skills compound naturally when you take more than one, without any program assuming you have taken another, and together they build toward the senior technical-leadership destination the next section lays out.

Where it leads

The path to Principal Engineer / Director

This track is built to carry you the whole way, from a first step with no data background to Principal Engineer or Director of Cloud and Data Platforms. Here is how the levels build.

From scratch to Principal Engineer and DirectorStart from scratchCuriosity and commitment, no data background neededData / Cloud EngineerBuild and run pipelines and platformsSenior Data Platform EngineerOwn systems end to end, across platformsLead / Staff EngineerDesign architecture and set technical directionPrincipal Engineer / Director - Cloud & Data PlatformsShape strategy, standards, and teams
Start from scratchCuriosity and commitment, no data background needed

Begin with the sibling tracks for coding and SQL, then the Data Engineering & Pipelines foundation here.

Data / Cloud EngineerBuild and run pipelines and platforms

The foundations, one cloud, a warehouse or lakehouse, and a processing or streaming engine give you a real engineer's toolkit.

Senior Data Platform EngineerOwn systems end to end, across platforms

Depth across multiple clouds, warehouses, and databases, plus operations, security, and cost, is what senior roles require.

Lead / Staff EngineerDesign architecture and set technical direction

Breadth across the whole stack, with the architecture, reliability, and governance judgment to design platforms others build on.

Principal Engineer / Director - Cloud & Data PlatformsShape strategy, standards, and teams

Mastery across the entire track, plus the architecture, leadership, and cross-domain judgment to own an organization's data platform strategy.

No single program makes you a principal engineer; the destination is reached through breadth across the whole stack combined with the architecture, operations, and leadership judgment that the senior material emphasizes. Each program contributes a real, in-demand piece of that breadth, and the further up the ladder you go, the more the emphasis shifts from building systems to designing them and setting the direction others follow.

How to choose

Find your starting point

Not sure where to begin? Match your situation to a program. If you are from a non-data background, start with the foundation and the sibling tracks above.

How knowledge builds

Cumulative by design

The sequence is built so that each stage rests on the one before, from a shared foundation up through the clouds, warehouses, engines, and databases to platform mastery.

Skills build cumulatively, from foundations to Principal EngineerFoundationsdata engineering and SQL across enginesCloud platformsAWS, Azure, and Google CloudWarehouses & lakehousesSnowflake and DatabricksProcessing & streamingSpark and KafkaDatabasesPostgreSQL, Oracle, SQL Server, ClickHouse
Why learn here

Practical, practitioner-built, portfolio-driven

Every program in this track shares a philosophy: learning should translate into capability you can demonstrate. Each is built around real platforms and real code, extended with worked examples that show the method rather than just naming the topic. Each ends with a project or capstone you can keep and show, because the point is not only to know the material but to prove you can apply it.

The programs are also built to fit together. Sequencing them as a journey means the foundation you build in one is assumed and extended by the next, so that a learner who follows the path develops a rounded, cumulative command of cloud and data platforms rather than a collection of disconnected courses. And because every program can be delivered as a private corporate cohort, teams can build the same capability together, aligned to their own data stack and platforms.

Corporate training

Build the capability across your team

Every program can be delivered as a tailored corporate cohort, aligned to your data stack and platforms, whether you are upskilling a data or platform team, onboarding new engineers, or building cloud and data capability toward senior and principal levels.

Scope a corporate engagement
FAQ

Frequently asked questions

What does this track cover?

The full cloud-and-data-platform journey: data engineering and pipelines, SQL across engines, the three major clouds (AWS, Azure, Google Cloud), the warehouses and lakehouses (Snowflake, Databricks), the processing and streaming engines (Spark, Kafka), and the databases (PostgreSQL, Oracle, SQL Server, ClickHouse).

Can I start from scratch with no data background?

Yes. The track is designed to take a motivated beginner from zero to the senior end of the field. Start with Data Engineering & Pipelines Foundations here, and use the sibling Programming and Data Analytics tracks for the coding and SQL basics, either first or in parallel. The start-here section on this page links them.

Where can this track lead?

For those who want it, all the way to Principal Engineer or Director of Cloud and Data Platforms. That destination is reached through breadth across the whole stack plus architecture, operations, and leadership judgment. The path-to-Principal section on this page lays out the career ladder.

In what order should I take the programs?

The programs are sequenced as a journey: the data-engineering and SQL foundations first, then a cloud, then a warehouse or lakehouse, a processing or streaming engine, and the databases. You can follow that order or enter wherever your goals fit. The how-to-choose guide on this page helps you decide.

Which cloud should I learn first?

Master one deeply first; the concepts transfer. AWS is the most widely used, Azure suits Microsoft-centric enterprises, and Google Cloud is strong for analytics. Breadth across all three is what senior and principal platform roles are built on.

Do I need the sibling tracks?

If you are new to coding or SQL, yes, as a prerequisite or parallel study: the Programming track builds Python and tooling, and the Data Analytics track builds SQL and data foundations. If you already have those, you can start directly in this track.

Are the programs self-paced or cohort-based?

Both, depending on the program. Most are available self-paced with hands-on labs, and mentor-led cohorts and private corporate delivery are available across the track.

Are the programs hands-on?

Yes. Every program is project-driven, with worked examples and code throughout and a portfolio-ready capstone, from a production data platform on a cloud to a tuned Spark job, a Kafka streaming system, or a real-time ClickHouse cluster.

Can my organization run these as private cohorts?

Yes. Every program can be delivered as a tailored corporate cohort, aligned to your data stack and platforms. Contact us to scope it.

Do you offer a brochure?

Yes. A downloadable PDF brochure summarizing the programs is available from the button at the top of the page.