# AI Evaluation (Evals) - All Guest Insights

*2 guests, 2 mentions*

---

## Hamel Husain & Shreya Shankar
*Hamel Husain & Shreya Shankar*

> "Both the chief product officers of Anthropic and OpenAI shared that evals are becoming the most important new skill for product builders."

**Insight:** The guests explicitly define this as a 'new skill' that is distinct from traditional software testing or general AI strategy. It involves a specific multi-step workflow (Error Analysis, Open Coding, A


## Brendan Foody
*Brendan Foody*

> "If the model is the product, then the eval is the product requirement document."

**Insight:** The guest explicitly states we are entering the 'era of evals' and describes it as a core bottleneck for AI labs. It involves creating rubrics, benchmarks, and systematic tests to measure model capabi


