Skip to content
Closed
Show file tree
Hide file tree
Changes from all commits
Commits
File filter

Filter by extension

Filter by extension

Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
6 changes: 6 additions & 0 deletions workshop/27-evaluate-workflow-quality.md
Original file line number Diff line number Diff line change
Expand Up @@ -97,6 +97,12 @@ Example record:

When you update your prompt or tools, rerun the workflow and compare answers across runs. A question that flips from `YES` to `NO` is a fast signal that quality regressed and needs investigation.

<picture>
<source media="(prefers-color-scheme: dark)" srcset="images/27-evals-quality-loop-dark.svg">
<source media="(prefers-color-scheme: light)" srcset="images/27-evals-quality-loop-light.svg">
<img alt="Evals quality loop: run workflow, ask binary questions, record YES/NO answers, and compare across runs to catch regressions" src="images/27-evals-quality-loop-light.svg">
</picture>

To refine your questions, return to Copilot CLI and describe what you observed:

```prompt
Expand Down
49 changes: 49 additions & 0 deletions workshop/images/27-evals-quality-loop-dark.svg
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
49 changes: 49 additions & 0 deletions workshop/images/27-evals-quality-loop-light.svg
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.