# Evaluations Examples

> This chapter explores Tactus evaluations - quantitative assessments of AI workflow performance across datasets.

Canonical: https://tactus.anth.us/examples/evaluations/

::band{columns="document-hero wide"}

[Examples](/examples/) / Evaluations

# Evaluations

This chapter explores Tactus evaluations - quantitative assessments of AI workflow performance across datasets.

::band{tone="muted"}

## Examples in This Chapter

### [Simple Eval](/examples/evaluations/simple-eval/)

A basic evaluation demonstrating core concepts without requiring LLM API calls. This example shows:
- Defining inline datasets with test cases
- Evaluation syntax with `Evaluation({...})`
- Expected output validation
- Success criteria based on exact output matching
- Running evaluations with `tactus eval`

*Has Specs*

### [Success Rate](/examples/evaluations/success-rate/)

Demonstrates success rate calculations and aggregated metrics. This example shows:
- Running multiple test cases in a single evaluation
- Calculating success rate across dataset
- Pass/fail criteria for individual test cases
- Aggregated statistics and reporting
- Using success rate to measure overall quality

*Has Specs · Requires API Keys*

### [Thresholds](/examples/evaluations/thresholds/)

Shows how to set minimum acceptable thresholds for metrics. This example demonstrates:
- Defining threshold requirements (e.g., success_rate >= 0.95)
- Evaluation failure when thresholds aren't met
- Multiple threshold configurations
- Using thresholds for quality gates in CI/CD
- Balancing strictness with practical tolerance

*Has Specs · Requires API Keys*

::band{columns="neighbors"}

- [*← Previous Chapter* **Specifications**](/examples/specifications/)
- [*Next Chapter →* **Advanced Features**](/examples/advanced-features/)

::band{columns="cta"}

## Want to contribute?

The examples repository is open source. Add your own examples or improve existing ones.

::button{href="https://github.com/AnthusAI/Tactus-examples" label="View on GitHub" size="lg"}
