Evaluating AI Is Harder Than Building It

AI evaluation is a tricky engineering challenge. With so many diverse tasks that we're trying to solve with AI, it will become increasingly complex to get it right. I propose the following framework: decompose the pipeline into small steps, design a measurable and reproducible evaluation approach, assess the interactions between steps and adjust accordingly.