Advanced
LLM Evaluation
Measure retrieval, generation, agents and production quality
Build evaluation systems for LLM applications: retrieval metrics, generation quality, agent trajectory eval, regression testing, online evaluation and eval-driven development.
Skills you'll gain
EvaluationRetrieval MetricsLLM-as-JudgeRegression TestingOnline EvalEval-Driven Dev
Prerequisites
LLM APIsRAG basics
Chapters
1
Evaluation FundamentalsAdvanced
Why eval, golden sets, metrics, and the eval-driven development loop.
28m
2
LLM-as-JudgeAdvanced
Using a model to score outputs at scale. Bias, calibration, and reliability.
30m
3
Online Eval & RegressionAdvanced
CI eval gates, online sampling, drift detection and the eval-driven deploy loop.
28m