Urgent.News

What's breaking now, across thousands of outlets.

More in AI

What agent frameworks cost on the wire: measurements from agentic-arena

Most framework comparisons argue from feature lists. I wanted numbers, so agentic-arena holds the model, tools, datasets and iteration budget fixed and measures what each framework does differently.

  • Vanilla baseline uses 753.5 prompt tokens per item in a 15-item tool-use task
  • smolagents framework uses 3,295.5 tokens, a 3.90x increase over vanilla baseline
  • smolagents is the only framework that can handle three consecutive 429 errors

More from Wednesday 30 September →