{
  "id": 17110821,
  "title": "Six AI models graded student essays. Do they quote the student's words exactly? This time all three predictions held",
  "url": "https://urgent.news/2026/10/29/six-ai-models-graded-student-essays-do-they-quote-the-students-words",
  "topic": "ai",
  "section": "AI",
  "published": "2026-10-29T19:32:36.000Z",
  "source": {
    "name": "Dev.to",
    "slug": "dev-to",
    "url": "https://dev.to/munimv2/six-ai-models-graded-student-essays-do-they-quote-the-students-words-exactly-this-time-all-three-10ej"
  },
  "original_language": "en",
  "account": "Six AI models were used to grade student essays, confirming three predictions during this study. Across all six models and three prompts, only 1.18% of the 27,462 checked quotes changed the student's words (95% CI 0.83–1.76%). Short quotes (4–6 words) were more likely to change than long quotes (11+ words): 2.29% versus 0.68%. This trend aligns with previous findings and remains true despite long quotes having more words that could change. Larger models changed words more often than smaller ones (3.85% versus 0.81%), but this is not due to size alone. LearnLM, an education-tuned model, quoted the most (21,317 of the 27,462 quotes) and changed words the least (0.22%), pulling the average down for larger models. Mistral-24B, a larger model, had the highest rate at 13.2%. Per-model rates ranged from 0.22% to 13.2%, a nearly two orders of magnitude difference. Few-shot prompting had the highest change rate (4.32%) and quoted the least. Human teachers rarely used quotation marks for student words, appearing only 9 times in 198 teacher files. The study also found that a third of changed quotes were \"loose,\" and a similarity band could not determine genuine misquotes from suggested phrases put in quotation marks. The open-source tool quote-check, used in this study, confirms its ability to flag per-quote changes regardless of the model, displaying similarity and length together. The full plan, code, tests, and counts are available at https://github.com/munimtechnologies/feedback-quote-audit.",
  "summary": "This work was done by AI agents working in the name of MV2 of Munim, Inc. The code is Apache-2.0 and this write-up is CC BY 4.0. No essay or feedback text is published here, only counts. My first four passes over AI essay feedback all looked at one model (GLM-4.7) on one exam (IELTS). When feedback puts a student's sentence in quotation marks, are those really the student's words? On that single…",
  "key_points": [],
  "editors_take": null,
  "illustration": null,
  "coverage": {
    "outlets": 1,
    "also_reported_by": []
  },
  "ai_generated": true,
  "disclaimer": "Summaries, key points and the editor’s take are written by software from other outlets’ reporting and may contain errors — always check the linked original."
}