Learnlytica
Book a demo
← All 186 courses
CL-227 Cloud & Platform

Open Table Formats: Iceberg, Delta & Hudi

Work fluently with the table formats that turned object storage into a warehouse. Learners implement ACID writes over files, read the metadata layer to explain a slow scan, evolve schema and partitioning without rewriting history, query snapshots by time travel, and run the compaction and expiry maintenance that keeps a table fast. The course closes with a defensible choice between Iceberg, Delta and Hudi for a stated workload and engine mix.

B4Professional
6modules
42skill atoms
3role journeys
Curriculum

What this course covers.

6 modules, 42 named skill atoms. Expand any module to see them.

1Why Open Formats Displaced Warehouses7 skill atoms
compute and storage decoupled from one vendorHive format limits from directory listing and no atomicitylock-in and egress cost of proprietary storageone copy read by many enginesfile format against table formatthe catalog as the missing piecewhat open formats do not solve
2ACID on Object Storage7 skill atoms
snapshot isolation over immutable filesoptimistic concurrency and commit conflictsatomic metadata pointer swapconsistency assumptions on S3, GCS and ADLScatalog-mediated commits and lockingconcurrent writers and retry behaviourcopy-on-write against merge-on-read deletes
3Metadata Layers and Manifests7 skill atoms
Iceberg metadata file, manifest list and manifestsDelta transaction log with JSON commits and checkpointsHudi timeline and file groupscolumn statistics driving file pruningmanifest bloat slowing query planningmetadata caching in the catalogreading metadata to debug a slow scan
4Schema and Partition Evolution7 skill atoms
add, drop, rename and reorder columns safelyfield IDs decoupling names from data filestype promotion rules and unsafe wideninghidden partitioning and partition transformschanging partition spec without rewriting historyliquid clustering as the Delta alternativequeries that break when partitioning changes
5Time Travel, Compaction and Maintenance7 skill atoms
querying as of a snapshot id or timestamprollback to a known good snapshotsmall-file problem from streaming writescompaction and bin-packing jobsexpiring snapshots and orphan file cleanupretention windows set against storage costdeferred maintenance as a slow outage
6Engine Interoperability and Choosing7 skill atoms
Spark, Trino, Flink and Snowflake support levelsREST catalog, Hive metastore, Glue and Unity Catalogwriter version and feature compatibility trapsIceberg chosen for engine neutralityDelta where Databricks is the centre of gravityHudi for high-frequency upserts and incremental pullsmigrating between formats and its real cost
Where it fits

CL-227 in the role journeys.

This course appears in 3 of our 45 role journeys. Here is what a learner takes immediately before and after it in each.

Data Platform Engineer

Professional stage
SEC-504→CL-227→CL-320

Data Engineer

Professional stage
CL-320→CL-227→CL-222

Data Cloud Engineer (Snowflake)

Professional stage
CL-407→CL-227→CL-504

Roles this course serves

Data Cloud Engineer (Snowflake)Data EngineerData Platform Engineer
The capability ladder

This course is authored to band B4.

Every course we run is written to one rung of the CASI ladder, so a plan can be assembled to take a team from where they are to where they need to be.

What do B1–B6 mean?The CASI Capability Ladder — click to expand

Every course targets a band on the CASI Capability Ladder — our six-band proficiency scale, anchored to open standards (O*NET, ESCO, NICE, NIST AI RMF, Bloom's). A band tells you how deep a course goes, and what evidence proves it.

What the learner can doTypical evidence
B1
AwareUnderstands concepts and vocabulary; uses tools with guidance
Knowledge checks
B2
FoundationPerforms standard tasks correctly in familiar contexts
Guided labs, autograded exercises
B3
PractitionerDelivers complete pieces of work independently
Scenario labs, proctored hands-on exams
B4
ProfessionalHandles production-grade complexity, trade-offs and failure modes
Break-fix drills, design defenses
B5
AdvancedEngineers systems end-to-end under constraints; leads others
Rubric-scored capstones, vivas
B6
ExpertSets direction; recognised authority across teams
Portfolio + panel evaluation

A note on B6. Courses in this catalog target B1–B5. B6 is not taught — it is recognised, through a portfolio and a panel, once someone is setting direction for others. Every journey here is built to land a learner at B5.

Related

Other Cloud courses at this level.

CL-202

AWS Solutions Architecture

B4 · Professional
CL-204

AWS Data Engineering

B4 · Professional
CL-212

Azure Solutions Architecture

B4 · Professional
CL-214

Azure Data Engineering

B4 · Professional
CL-222

Google Cloud Data Engineering Bootcamp

B4 · Professional
CL-223

GCP Architecture & Operations

B4 · Professional
Next step

Run CL-227 for your team.

This course runs at several lengths depending on how deep you need to go and how much of it your people already have. Tell us who is being trained and we will scope it.

Add it to a training plan Talk to our team Check your team’s level free