Microsoft’s move in the AI school debate: controls over how student data gets used

A week after New York City's AI moratorium in public schools, Microsoft unveiled a plan to offer every school district nationwide the ability to set its own AI privacy and safety rules within its contracts. Microsoft Vice Chair and President Brad Smith joined American Federation of Teachers President Randi Weingarten and United Federation of Teachers President Michael Mulgrew to announce the "National AI Safety & Privacy Standard" at a press conference near the announcement of the moratorium.

The agreement, legally enforceable once included in a district's Microsoft contract, gives school districts the power to dictate how AI products manage student data. Companies are prohibited from using student data for AI model training, tracking students, or making decisions without human review. Districts can also terminate contracts and seek damages for rule violations.

The standard's implementation begins November 1 for all districts Microsoft works with, regardless of whether they adopt the provisions. Microsoft President Brad Smith emphasized the agreement's transparency, stating it includes five key protections: privacy, safety, transparency, a 72-hour breach reporting requirement, and a ban on using student data for advertising.

Weingarten, who previously advocated for specific bans on K-2 students and companion chatbots for minors under 16, highlighted the importance of contract-based safeguards in addressing AI's potential dangers.