{
  "id": 2134422,
  "title": "Chinese AI chips fall short on coding, forcing firms to stretch scarce Nvidia supply",
  "url": "https://urgent.news/2026/08/20/chinese-ai-chips-fall-short-on-coding-forcing-firms-to-stretch-scarce",
  "topic": "ai",
  "section": "AI",
  "published": "2026-08-20T12:30:12.000Z",
  "source": {
    "name": "SCMP Tech",
    "slug": "scmp-tech",
    "url": "https://www.scmp.com/tech/tech-trends/article/3364700/chinese-ai-chips-fall-short-coding-forcing-firms-stretch-scarce-nvidia-supply"
  },
  "original_language": "en",
  "account": "Chinese AI companies are adapting their software to manage the surge in demand for inference, relying on a limited supply of high-end chips due to restricted access to Nvidia processors. While training AI models can benefit from advanced hardware, applying those models to tasks like coding, known as inference, often requires Nvidia chips, leaving Chinese firms facing significant compute constraints as AI shifts from development to deployment. Inference demands high-quality tokens, which far exceed domestic chip production capabilities, particularly in complex tasks like coding. Professionals in the field note that even with domestic processors, inference can only handle lower-quality tasks with limited demand and monetisation. Consequently, Chinese AI firms are exploring alternative solutions, such as Moonshot's data transmission library for heterogeneous inference and Approaching.AI's heterogeneous P/D disaggregation technique. These methods enable different chips to manage distinct parts of AI tasks, potentially reducing costs by 10 to 20 times. Moonshot's library facilitates efficient data exchange between Nvidia H200 and Huawei Ascend 910B chips, while Approaching.AI's KTransformers inference engine ran DeepSeek's full-size model on a single Nvidia RTX 4090, along with a central processing unit and substantial memory. This approach has yielded financial success, with Approaching.AI's revenue surpassing last year's total by June.",
  "summary": "Chinese AI companies are optimising software to cope with surging demand for inference, as part of that workload still relies on computing power from a limited pool of high-end chips amid restricted access to Nvidia processors. Compared with training an artificial intelligence model, which relies on high-end chips, inference – a later phase in which the trained model applies its knowledge to…",
  "key_points": [
    "Chinese AI firms struggle with Nvidia chip shortage for inference tasks",
    "Domestic chips inadequate for high-quality coding inference demands",
    "Alternative solutions like Moonshot and Approaching.AI techniques explored"
  ],
  "editors_take": null,
  "illustration": null,
  "coverage": {
    "outlets": 2,
    "also_reported_by": [
      {
        "outlet": "South China Morning Post",
        "title": "Chinese AI chips fall short on coding, forcing firms to stretch scarce Nvidia supply",
        "url": "https://urgent.news/2026/08/20/chinese-ai-chips-fall-short-on-coding-forcing-firms-to-stretch-scarce-2136942",
        "published": "2026-08-20T12:30:12.000Z"
      }
    ]
  },
  "ai_generated": true,
  "disclaimer": "Summaries, key points and the editor’s take are written by software from other outlets’ reporting and may contain errors — always check the linked original."
}