Urgent.News

What's breaking now, across hundreds of outlets.

AI

Why AI Apps Crash Under Real Traffic (And How to Fix It in 2 Lines)

TL;DR: Generic retry wrappers like p-retry or while loops weren't built for LLM APIs. They multiply SDK retries into 9x–12x traffic storms , sleep on hard billing errors ( insufficient_quota ), corrupt streamed UI text on mid-stream disconnects, and break tool-call message histories. @rohan9024/retrykit ( v2.0.0 ) is a zero-dependency TypeScript reliability engine for AI apps that solves rate…

AI applications often crash under real-world traffic due to inadequate retry mechanisms. Generic retry wrappers and while loops do not account for the unique challenges posed by large language model (LLM) APIs. RetryKit (@rohan9024/retrykit) is a zero-dependency TypeScript reliability engine that addresses issues such as rate limits, circuit breaking, stream recovery, and atomic context compaction.

Implementing RetryKit in a few lines of code can prevent cascading failures, duplicate streamed text, and billing spikes caused by poorly handled API errors.

Rewritten by urgent.news; may contain errors — check the original.

Read the original at dev.to →

Report a problem with this story

More in AI

公辦政見會 沈伯洋:市民當考官檢驗政見 蔣萬安提東南西北建設藍圖

〔記者甘孟霖、蔡愷恆/台北報導〕台北市長選舉昨進行第二場公辦政見發表會,藍綠候選人持續短兵相接。民進黨台北市長候選人沈伯洋表示,治理城市不能只是「哪裡受傷就貼一塊OK繃」,夏莉絲兒虐案、寶林茶室及基泰大直案,北市府一再錯失處理問題的第一時間,若他當選將會「搶回這一步」。他承諾將政見化為待辦事項清單,…

管控軍用AI 美中有共識

川普宣揚三方峰會成果 〔編譯林家宇/綜合報導〕美國總統川普在美東時間廿日率部會首長親赴白宮記者室,說明十九日中國深圳進行的美中俄領袖峰會成果。川普稱與中國國家主席習近平、俄羅斯總統普廷關係極佳,彼此「非常來電」(great electricity)。這樣的關係不但對美國與全球安全有益,也有助推動削…

Built your app with AI? 10 security checks before real users sign up

AI app builders and coding agents can take you from an idea to a working app in a weekend. That's genuinely useful. But "it works when I click through it" and "it's safe with real people's data in it"…

  • AI apps can be built quickly but require security attention
  • 159,041 Lovable projects had security issues in November 2026
  • 51 security advisories published by Next.js in 2026

More from Saturday 21 November →