A prestigious university used AI to monitor its entrance exam. It turned into a disaster

A renowned Mexican university, the National Autonomous University of Mexico (UNAM), initially faced backlash when it decided to transition its highly competitive entrance exam to an online format utilizing artificial intelligence (AI) for monitoring. The decision sparked protest from students and professionals alike who argued against the use of AI, with demonstrators chanting "We demand honesty, not artificial intelligence."

UNAM typically admits around 50,000 students annually; however, the majority of these spots are reserved for students from its 14 preparatory high schools, leaving 22,000 places open through the entrance exam. This year, approximately 160,000 students registered for the test.

Traditionally, the exam was administered in person with a human proctor to ensure academic integrity. For the 2023 test, two software solutions were implemented: LockDown, a browser to prevent access to other tabs or programs, and an AI proctoring system from Territorium. The AI proctor, designed to monitor applicants via webcam for signs of cheating, proved to be controversial.

Experts suspect the system may have failed to detect numerous instances of cheating, with previous five-year data showing only 0.9% of participants scoring 110 or higher. This year, that figure increased to 5.5%, raising suspicions of widespread cheating.

Upon analyzing the results, mathematician Raúl Rojas estimated that around 75,000 test-takers, roughly half of the applicant pool, may have cheated. This estimation suggests that the AI proctor, despite its surveillance capabilities, left significant room for academic dishonesty. Students allegedly employed various cheating methods, such as using a "cheat sheet," positioning a second monitor outside the webcam's view to input responses from AI assistance, or concealing headphones under their hair.

Despite Territorium's lack of response to inquiries about the issue, social media was rife with cheating strategies circulating prior to the exam.

In response to the allegations of widespread cheating, UNAM established an expert committee tasked with investigating the matter. The committee recommended a "control exam," requiring all admitted applicants via the online format, along with those whose scores would have granted them admission in the past five years, to retake the entrance exam in person.

This decision affects 58,000 applicants who must now undergo a second, physical examination. The move underscores the university's commitment to ensuring academic integrity, despite the challenges presented by the AI proctoring system's shortcomings.