Setting up your first evaluation

In this lightning session you will learn to:

Identify your AI feature's specific evaluation metrics

Move beyond generic metrics to specifics that measure the ways your AI feature fails for your specific use case

How to choose between deterministic and LLM-based evaluation

Understand when to use zero-cost deterministic checks vs. AI-as-judge, and why you should start with deterministic first

Build your first automated evaluation

Set up practical deterministic checks: format validation, schema checks, length limits, and value ranges