Compare ChatGPT, Gemini, DeepSeek, and other AI models — stop juggling AI tabs for $54.97
Compare ChatGPT, Gemini, DeepSeek, and other AI models with ChatPlayground AI, now $54.97 for lifetime access during this early Black Friday deal.
Two Gemini Flash-Lite models were given nine real GitHub bug reports to fix, with each model fixing one bug. Between them, they made 964 model calls during the process. The tasks were sourced from SWE-bench-Live, using small pure-Python repositories that could be run on a Windows machine without Docker. The model calls were made using the free tier versions of Gemini 3.5 and 3.1, resulting in different costs based on token usage.
Overall, the agents spent a total of approximately $0.56 to $0.43 per task to fix the bugs, with a cost of about 43 to 56 cents per fixed bug.
Rewritten by urgent.news; may contain errors — check the original.
Sources: dev.to · mashable.com
This story
This is one outlet's version. Read the fullest account.