← All 186 courses
CL-405 Cloud & Platform

GPU & AI Infrastructure Operations

Operate the infrastructure layer under enterprise AI: GPU node pools and scheduling on Kubernetes, serving stacks (vLLM behind LiteLLM), semantic caching, cost-aware start/park automation, and capacity planning for inference — bridging platform engineering and the AI band.

B5Advanced
5modules
35skill atoms
1role journey
Curriculum

What this course covers.

5 modules, 35 named skill atoms. Expand any module to see them.

1GPU on Kubernetes7 skill atoms
device pluginsnode poolsscheduling AI podsNVIDIA driver & container toolkit versionsnvidia.com/gpu resource requestsMIG partitioning vs time-slicingGPU node taints and tolerations
2Serving Stack Assembly7 skill atoms
vLLM deployLiteLLM gatewayfallbackscontinuous batching & KV cache memorytensor parallelism across GPUsmodel weight loading & cold startper-team routing and rate limits
3Semantic Cache Layer7 skill atoms
threshold tuninghit-rate monitoringembedding model & vector store choicesimilarity threshold vs false-hit riskTTL and invalidation on model changeper-tenant cache isolationlatency and cost saved per hit
4Cost-Aware Automation7 skill atoms
auto-start/parkutilisation dashboardsidle GPU detection windowsscale-to-zero dev endpointsspot GPU with checkpoint & resumeGPU-hour chargeback per teamquota and reservation management
5Inference Capacity Lab7 skill atoms
load testGPU sizingscaling policytime-to-first-token & tokens/sec targetsconcurrency vs latency curvequeue depth as the scaling signalcost per million tokens at target latency
Where it fits

CL-405 in a role journey.

This course appears in 1 of our 45 role journeys. Here is what a learner takes immediately before and after it in each.

AI Infrastructure Engineer

Capstone stage
AI-312CL-405AI-212

Roles this course serves

The capability ladder

This course is authored to band B5.

Every course we run is written to one rung of the CASI ladder, so a plan can be assembled to take a team from where they are to where they need to be.

What do B1–B6 mean?The CASI Capability Ladder — click to expand

Every course targets a band on the CASI Capability Ladder — our six-band proficiency scale, anchored to open standards (O*NET, ESCO, NICE, NIST AI RMF, Bloom's). A band tells you how deep a course goes, and what evidence proves it.

What the learner can doTypical evidence
B1
AwareUnderstands concepts and vocabulary; uses tools with guidance
Knowledge checks
B2
FoundationPerforms standard tasks correctly in familiar contexts
Guided labs, autograded exercises
B3
PractitionerDelivers complete pieces of work independently
Scenario labs, proctored hands-on exams
B4
ProfessionalHandles production-grade complexity, trade-offs and failure modes
Break-fix drills, design defenses
B5
AdvancedEngineers systems end-to-end under constraints; leads others
Rubric-scored capstones, vivas
B6
ExpertSets direction; recognised authority across teams
Portfolio + panel evaluation

A note on B6. Courses in this catalog target B1–B5. B6 is not taught — it is recognised, through a portfolio and a panel, once someone is setting direction for others. Every journey here is built to land a learner at B5.

Next step

Run CL-405 for your team.

This course runs at several lengths depending on how deep you need to go and how much of it your people already have. Tell us who is being trained and we will scope it.

Add it to a training plan Talk to our team Check your team’s level free