Urgent.News

What's breaking now, across thousands of outlets.

More in AI

API Gateway HTTP API + Lambda Function URLs: Building a Prompt‑Caching LLM Proxy, Explained Simply

LLM‑powered features like code completion are often wrapped in heavyweight Lambda functions that add latency and cost. By letting API Gateway’s HTTP API route directly to a lightweight Function URL…

  • HTTP API v2 and Function URLs reduce latency and costs for LLM features.
  • In-process cache within Lambda provides faster access and lower costs.
  • API Gateway’s Function URLs offer direct HTTPS endpoint without extra layers.

More from Monday 12 October →