Urgent.News

What's breaking now, across hundreds of outlets.

AI

Where an agent's tokens go: 9 real GitHub bugs, two Gemini Flash-Lite models, 1 fix each

I gave two Gemini Flash-Lite models the same 9 real bug reports from GitHub and let each one work in a loop: search, read a file, edit, run the tests, submit. Each model fixed one bug. Between them they made 964 model calls. The tasks come from SWE-bench-Live (github.com/microsoft/SWE-bench-Live, MIT). I picked small pure-Python repos I could run on a Windows machine without Docker: attrs, faker…

Two Gemini Flash-Lite models were given nine real GitHub bug reports to fix, with each model fixing one bug. Between them, they made 964 model calls during the process. The tasks were sourced from SWE-bench-Live, using small pure-Python repositories that could be run on a Windows machine without Docker. The model calls were made using the free tier versions of Gemini 3.5 and 3.1, resulting in different costs based on token usage.

Overall, the agents spent a total of approximately $0.56 to $0.43 per task to fix the bugs, with a cost of about 43 to 56 cents per fixed bug.

Rewritten by urgent.news; may contain errors — check the original.

Read the original at dev.to →

Report a problem with this story

More in AI

ChatGPT Reads the Lyrics, Not the Tune

When you talk to ChatGPT it feels like it is listening. I wanted to know what actually arrives on the other side, so I picked the simplest thing a voice carries besides words: a melody.

ASML vs. SK Hynix: Which Artificial Intelligence Stock Is a Better Buy for 2027?

ASML's near-monopoly on EUV lithography stands against SK Hynix's surging AI memory business, but their valuation gap is wider than either company's fundamentals suggest.

  • ASML specializes in lithography systems for high-end chip manufacturing.
  • SK Hynix produces memory hardware, including high-bandwidth memory for AI.
  • SK Hynix's stock appears undervalued amid AI market growth.

The Anthropic IPO Was a Massive Wealth Transfer

The vast majority of employees of the tech company Anthropic are now millionaires, thanks to the Claude-maker’s record-breaking IPO this week. That’s about 5,100 people, or 96% of their workforce. There are so many newly-minted AI millionaires that some writers have speculated the IPO’s winners will soon strain San Francisco’s housing…

  • 5,100 Anthropic employees became millionaires overnight
  • Founders and executives hold more wealth than 45M poorest Americans
  • Philanthropic commitments appear voluntary, not binding

More from Saturday 21 November →