{
  "id": 3448245,
  "title": "Overreaching causal language in the social sciences",
  "url": "https://urgent.news/2026/08/26/overreaching-causal-language-in-the-social-sciences",
  "topic": "science",
  "section": "Science",
  "published": "2026-08-26T06:54:58.000Z",
  "source": {
    "name": "Marginal Revolution",
    "slug": "marginal-revolution",
    "url": "https://marginalrevolution.com/marginalrevolution/2026/08/overreaching-causal-language-in-the-social-sciences.html"
  },
  "original_language": "en",
  "account": "Across the social sciences, numerous studies utilize cross-sectional designs that uncover associations but are typically incapable of substantiating direct causal claims. However, authors of such papers may assert or insinuate causal claims nonetheless. In order to ascertain the frequency of this \"overreaching\" causal language, a study analyzed 194,631 cross-sectional articles employing large language models. Over the timeframe of 1980 to 2024, an average of 46% of these articles contained causal language within their titles or abstracts, with the annual rate surging nearly threefold since the year 2000 from 20% to 60%. To investigate the impact of such language, a human-subjects experiment with N = 1,105 participants was conducted, revealing that readers often perceive abstracts featuring this phrasing as providing causal evidence. Nonetheless, methodological labels (β = -0.4, 95% confidence interval -0.56 to -0.19) and associational wording (β = -0.3, 95% confidence interval -0.43 to -0.07) tended to diminish this inclination. Experiments involving five different large language models (LLMs) demonstrated that model summaries of these articles (N = 100 each) could exacerbate the overstatement of causality, eliminating cautionary language and introducing causal claims where only associational phrasing was utilized; however, prompting caution did mitigate this pattern. This finding is derived from a recent paper by Calvin Isch, Timothy Dörr, Neil Fasching, Grace Jennings, and Duncan J. Watts.",
  "summary": "Across the social sciences, many studies use cross-sectional designs that reveal associations but are generally unable to support direct causal claims, yet authors of such articles may make or imply causal claims anyway. Here, to examine the prevalence of such ‘overreaching’ causal language, we analysed 194,631 cross-sectional articles using large language models. Over the period […] The post…",
  "key_points": [
    "46% of cross-sectional articles contain overreaching causal language",
    "Annual rate of such language increased nearly threefold since 2000",
    "Human readers perceive causal language as providing causal evidence"
  ],
  "editors_take": "The widespread use of causal language in social science studies that can't support such claims means readers often misinterpret findings as causal evidence, despite methodological labels and associational wording offering some corrective.",
  "illustration": null,
  "coverage": {
    "outlets": 1,
    "also_reported_by": []
  },
  "ai_generated": true,
  "disclaimer": "Summaries, key points and the editor’s take are written by software from other outlets’ reporting and may contain errors — always check the linked original."
}