{
  "id": 12356980,
  "title": "I tested 11 AI models on Indian GST, UPI and lakh-crore. Three famous ones got Puducherry wrong.",
  "url": "https://urgent.news/2026/10/06/i-tested-11-ai-models-on-indian-gst-upi-and-lakh-crore-three-famous",
  "topic": "ai",
  "section": "AI",
  "published": "2026-10-06T10:34:02.000Z",
  "source": {
    "name": "Dev.to",
    "slug": "dev-to",
    "url": "https://dev.to/ankithm1006/i-tested-11-ai-models-on-indian-gst-upi-and-lakh-crore-three-famous-ones-got-puducherry-wrong-53e9"
  },
  "original_language": "en",
  "account": "A Kaggle Benchmarking Challenge examined how well various AI models could handle everyday Indian business data, including GSTIN validation, UPI reconciliation, and formatting of large numbers. Results showed that three renowned models incorrectly identified Puducherry as a Union Territory rather than a State, and that smaller, open-weight models like gpt-oss-20b and Gemma 4 performed better on some tasks compared to larger, faster models. Checksum errors were particularly challenging for faster models, with some missing bills altogether, leading to potential financial losses. Open-weight models like gpt-oss-20b and Gemma 4 31B offered the best value, achieving high scores for a lower cost.",
  "summary": "This is a submission for the Kaggle Benchmarking Challenge What I Benchmarked I build software for Indian small businesses (POS, billing, payments), and this month I've been contributing Kestra workflow blueprints for Indian finance: GSTIN validation, UPI end-of-day close, GSTR-2B reconciliation. Every one of them exists because one small mistake costs real money: one mistyped character in a…",
  "key_points": [
    "Three renowned AI models incorrectly identified Puducherry as a Union Territory",
    "Smaller open-weight models like gpt-oss-20b and Gemma 4 performed better",
    "Open-weight models offered better value for handling Indian GST and UPI tasks"
  ],
  "editors_take": null,
  "illustration": null,
  "coverage": {
    "outlets": 1,
    "also_reported_by": []
  },
  "ai_generated": true,
  "disclaimer": "Summaries, key points and the editor’s take are written by software from other outlets’ reporting and may contain errors — always check the linked original."
}