Microsoft commits to sweeping AI privacy rules for students. Will other tech giants follow?

Millions of students daily utilize AI chatbots for academic assistance, emotional support, and personal guidance, often unaware of the destination of their conversations and personal data. Microsoft has recently agreed to implement stringent privacy rules for its AI in educational settings, following negotiations with the American Federation of Teachers, the second-largest teachers' union in the nation.

These safeguards are significant, but will only prove effective if all AI corporations, especially the tech behemoths, adhere to the guidelines, according to Josh Golin, director of the online safety nonprofit Fairplay.

The agreement prohibits Microsoft from employing student or educator data for AI training, except for a limited exception to enhance student protection. Additionally, the data collected cannot be sold, utilized for advertising purposes, or employed in product development. Microsoft will not incorporate AI companions or features that cultivate emotional attachments or engagement beyond the scope of a learning task.

The agreement also mandates third-party audits to ensure compliance and requires Microsoft to disclose the workings of its tools in simple language to parents and educators.

Brad Smith, Microsoft's vice chair and president, expressed confidence that the agreement sets a high standard for child privacy and AI safety, intending to extend these measures to all school districts across the United States. The agreement takes effect on November 1, covering any school district with which Microsoft has existing contracts.

AFT President Randi Weingarten hailed the pact as "the first of its kind" and a crucial step towards establishing an industry standard in light of the lack of federal and state legislation concerning AI in educational institutions.

School districts in New York City and Los Angeles have implemented a one-year hiatus on student AI usage, giving them time to study and incorporate the technology into education. The teachers' union has also reached out to Google to inquire about potential adherence to the same standards, though the company has yet to respond to an AP request for comment.