{
  "id": 15414884,
  "title": "How Do AI Companies Get Their Training Data?",
  "url": "https://urgent.news/2026/10/18/how-do-ai-companies-get-their-training-data",
  "topic": "ai",
  "section": "AI",
  "published": "2026-10-18T13:29:56.000Z",
  "source": {
    "name": "Dev.to",
    "slug": "dev-to",
    "url": "https://dev.to/aidata_broker/how-do-ai-companies-get-their-training-data-2la"
  },
  "original_language": "en",
  "account": "AI companies obtain their training data through six main channels: crawling the open web, licensing content from publishers and platforms, commissioning human and expert data, buying or licensing records that companies already hold, building simulated environments and synthetic data, and utilizing their own users' data. Crawling the open web is the largest and most prevalent channel, with one monthly Common Crawl archive holding 2.17 billion web pages. Licensing content from publishers and platforms is also growing, with Reddit signing a $203.0 million data license deal. Commissioning human and expert data is another rising channel, with companies paying experts and contractors an average of $60 million per month. Buying company records, such as email, chat, tickets, and CRM data, is gaining traction as well, with Spirit Airlines' archive recently sold for $5 million to $12.5 million. Building environments and synthetic data for training models is the fastest-growing channel, with 89 vendors selling environments at varying price points. Lastly, using users' own data, such as posts, chats, and uploads on platforms like LinkedIn, Meta, and X, is expanding, although the cost is typically regulatory compliance. The mix of these channels is shifting, with licensing, commissioning expert data, buying company records, and synthetic data generation becoming more prominent, while crawling the open web faces challenges such as an increasing number of sites blocking AI crawlers.",
  "summary": "Originally published at aidata.broker . AI companies get their training data through six channels: they crawl the open web, license content from publishers and platforms, pay experts and contractors to make data to order, buy or license records that companies already hold, build simulated environments and synthetic data, and use what their own users write and upload. The first channel built…",
  "key_points": [
    "AI companies obtain training data through six main channels.",
    "Crawling the open web is the largest and most prevalent channel.",
    "Licensing content from publishers and platforms is growing."
  ],
  "editors_take": null,
  "illustration": null,
  "coverage": {
    "outlets": 1,
    "also_reported_by": []
  },
  "ai_generated": true,
  "disclaimer": "Summaries, key points and the editor’s take are written by software from other outlets’ reporting and may contain errors — always check the linked original."
}