My Snowflake Agent Was Wrong. So Was My Evaluation.
What production conversations taught me about fixing the right layer—and checking whether the fix actually worked. When an agent gets a disappointing evaluation score, I now ask three questions: Did it answer the question correctly? Did it take an appropriate path to the answer? Was the evaluation measuring the behavior I actually wanted? In my Snowflake agent, those answers did not always agree.…
We haven't written up this one. Dev.to has the full story — the link below goes straight to it.
