Advanced
12h
LLMOps and AI Observability
Operate AI systems with tracing, evaluation pipelines, regression tests, cost monitoring, and production dashboards. Learn the engineering discipline behind reliable LLM products.
12 lessons
Prompt versioning and experiment trackingDataset versioning for evaluationEvaluation pipelines: automated and humanLLM-as-judge patterns and calibration+8 more