AI & Agent Observability
See inside AI systems: OpenTelemetry-based tracing for LLM calls and agent steps, token and latency dashboards, loop and anomaly detection, and runbook-driven alerting — so 3 a.m. AI incidents are diagnosable by whoever is on call, not just the author.
What this course covers.
5 modules, 31 named skill atoms. Expand any module to see them.
1Tracing AI Workloads6 skill atoms
2Dashboards that Matter7 skill atoms
3Agent-Specific Signals6 skill atoms
4Alerting & Runbooks6 skill atoms
5On-Call Simulation6 skill atoms
AI-404 in the role journeys.
This course appears in 4 of our 45 role journeys. Here is what a learner takes immediately before and after it in each.
Roles this course serves
This course is authored to band B4.
Every course we run is written to one rung of the CASI ladder, so a plan can be assembled to take a team from where they are to where they need to be.
What do B1–B6 mean?The CASI Capability Ladder — click to expand
Every course targets a band on the CASI Capability Ladder — our six-band proficiency scale, anchored to open standards (O*NET, ESCO, NICE, NIST AI RMF, Bloom's). A band tells you how deep a course goes, and what evidence proves it.
A note on B6. Courses in this catalog target B1–B5. B6 is not taught — it is recognised, through a portfolio and a panel, once someone is setting direction for others. Every journey here is built to land a learner at B5.
Other AI courses at this level.
Departmental AI Adoption & Automation Design
Transformers from First Principles
Fine-Tuning with Hugging Face
Distributed Training Foundations
Synthetic Data Generation & Evaluation
Vector Databases & Hybrid Search
Run AI-404 for your team.
This course runs at several lengths depending on how deep you need to go and how much of it your people already have. Tell us who is being trained and we will scope it.