← All 186 courses
CL-407 Cloud & Platform

Streaming Data Platforms (Kafka · Pub/Sub · Event Hubs)

Design event-driven data movement that doesn't lose or duplicate: partitioning and ordering, consumer groups, delivery semantics, schema management, dead-letter patterns, and replay — taught across Kafka and cloud-native brokers so the concepts, not the vendor, stick.

B4Professional
5modules
34skill atoms
3role journeys
Curriculum

What this course covers.

5 modules, 34 named skill atoms. Expand any module to see them.

1Streaming Mental Model7 skill atoms
logspartitionsordering guaranteesoffsets in an append-only logordering only within a partitionkey-based partition assignmentretention by time vs size
2Producers & Consumers7 skill atoms
consumer groupsoffsetsrebalancingacks & idempotent producerbatching and linger trade-offconsumer lag monitoringrebalance storms from slow processing
3Delivery Semantics6 skill atoms
at-least/exactly-once truthidempotent designtransactions & read-committed consumerscommit-after-process vs auto-commitdedup keys at the sinkduplicates emitted during rebalance
4Schema & Evolution7 skill atoms
registriescompatibility rulesAvro vs Protobuf vs JSON Schemabackward, forward & full compatibilityadding fields with defaultsproducer-before-consumer rollout orderschema id in the message envelope
5Failure Patterns7 skill atoms
DLQsreplay drillspoison-message handlingretry topics with backoffoffset reset by timestampreplay without duplicating side effectslag alert thresholds
Where it fits

CL-407 in the role journeys.

This course appears in 3 of our 45 role journeys. Here is what a learner takes immediately before and after it in each.

Data Platform Engineer

Practitioner stage
CL-214CL-407CL-311

Data Engineer

Professional stage
CL-214CL-407CL-406

Data Cloud Engineer (Snowflake)

Professional stage
CL-317CL-407CL-227

Roles this course serves

The capability ladder

This course is authored to band B4.

Every course we run is written to one rung of the CASI ladder, so a plan can be assembled to take a team from where they are to where they need to be.

What do B1–B6 mean?The CASI Capability Ladder — click to expand

Every course targets a band on the CASI Capability Ladder — our six-band proficiency scale, anchored to open standards (O*NET, ESCO, NICE, NIST AI RMF, Bloom's). A band tells you how deep a course goes, and what evidence proves it.

What the learner can doTypical evidence
B1
AwareUnderstands concepts and vocabulary; uses tools with guidance
Knowledge checks
B2
FoundationPerforms standard tasks correctly in familiar contexts
Guided labs, autograded exercises
B3
PractitionerDelivers complete pieces of work independently
Scenario labs, proctored hands-on exams
B4
ProfessionalHandles production-grade complexity, trade-offs and failure modes
Break-fix drills, design defenses
B5
AdvancedEngineers systems end-to-end under constraints; leads others
Rubric-scored capstones, vivas
B6
ExpertSets direction; recognised authority across teams
Portfolio + panel evaluation

A note on B6. Courses in this catalog target B1–B5. B6 is not taught — it is recognised, through a portfolio and a panel, once someone is setting direction for others. Every journey here is built to land a learner at B5.

Next step

Run CL-407 for your team.

This course runs at several lengths depending on how deep you need to go and how much of it your people already have. Tell us who is being trained and we will scope it.

Add it to a training plan Talk to our team Check your team’s level free