Designing AI Evals: Clarity Now and Visualization Next
AI evals and analysis Let's say you're testing out new AI tools. Perhaps you implement and run analytics for an Ad Agency and hope to automate deploying your standard event schema, or are a podcast producer automating generating social copy from your newest ep. While modern, newly trained LLMs can likely one-shot a lot of these tasks – this specificity might necessitate wasting tokens and time…
We haven't written up this one. Dev.to has the full story — the link below goes straight to it.