LinkedIn · Image
With a few thousand traces, it’s easy to miss failed actions and user feedback. We tested whether evals could help data agents find both. Across 7 models, SQL searches with an eval-as-index scored 23% higher on answer quality and used 24% fewer input tokens on average.