Universities Cannot Grade AI-Era Writing From the Final Paper | Opinion
AI detectors are unreliable. Universities should assess how students develop and defend their work, not only the finished essay.
The writer, who previously worked on plagiarism-detection tools in the field of neuroscience, now faces a new challenge brought about by generative AI. This new technology lacks a clear source for comparison, making it difficult to determine if a piece of writing is AI-generated or human-created. The issue has led to false positives when using AI detection software, resulting in unjust accusations against students.
A study found that seven popular detectors incorrectly flagged 61 percent of genuine human writing as AI-generated, particularly affecting non-native English speakers. Universities are struggling to establish the knowledge and skills students have acquired, as many assessments are unsupervised and can be completed with limited student engagement, sometimes in minutes, using AI tools.
The current system fails to account for the writing process, only evaluating the final submission, which makes it difficult to determine what a student has actually learned. Some institutions have responded by disapproving the use of detection tools due to their unreliability and potential for false positives. However, this approach only provides a temporary solution, as it does not address the underlying issues related to assessing writing in the age of AI.
Universities must consider the writing process as part of the assessment, rather than merely evaluating the final product. This approach could involve examining the student's development throughout the writing process, their ownership of the final result, and how the work was shaped. By doing so, universities can create a more reliable assessment system that distinguishes between honest use of AI tools and actual cheating.
This change would not only help protect honest students but also ensure that degrees maintain their value and continue to be a reliable indicator of a graduate's capabilities.
Written by urgent.news from Newsweek's reporting — not their text. Machine-written — may contain errors; check the original before relying on it.