Google Forcing AI on Students Is BS

Google has come under scrutiny for its decision to force K-12 schools to enable AI tools, specifically the Gemini chatbot, for over 150 million students. The company quickly backtracked and decoupled the services from Google search, but made it clear that search will continue to be AI-driven. This decision has sparked a debate among educators, students, and parents across the U.S. about how schools should respond to the rise of AI-enabled tools.

In August, Google activated Gemini for K-12 students on Google Classroom, leaving educators scrambling to respond. The company further complicated matters by introducing a new way to turn off Gemini, but administrators would also be turning off Google search in the process. Google later clarified that Gemini, Gemini notebook, and Search will have their own controls and will be off by default.

However, this change still exhibits the tech giant's broader approach to force AI on all search users, making it an example of a monopolist pushing unwanted changes into the classroom.

Google's move to tie AI to Search is part of its strategy of offering a cheap convenience at a major loss, in hopes of following Uber's enshittification playbook. This puts Google in an odd position as an incumbent, with around 90% of search traffic. The company must protect its dominance from new AI tools while making good on its AI investments.

However, the public is divided on AI, and users have mixed reactions to these changes. Some welcome the enhancements, while others are concerned about the accuracy of AI overviews and their impact on click-through rates for online communities and small publishers. The inconvenience of switching to alternative services is often enough to trap users in Google's ecosystem.

Smaller services like DuckDuckGo and Brave Search offer simple and persistent AI settings, which don't require logging in. These services also clearly distinguish between generated AI summaries, suspected AI results, and the backend use of AI to curate links. While tricks like adding "-ai" to Google searches can remove AI Overview, they are not meant to be an all-encompassing AI off-switch and can change at any time.

De-googling schools is a challenging task due to the high switching costs involved. Schools face major hurdles when moving to a competitor, including lengthy contract processes, staff retraining, and cumbersome migrations of past work. For this reason, granular controls over generative AI are essential, especially considering the hot-button issue of AI in education.

Parents and teachers concerned about AI disrupting learning are pushing for temporary AI moratoriums in major school districts, aiming to ensure that any introduction of AI fits students' needs and is done in a way that guarantees educators are prepared. Ultimately, these decisions must be made by schools, not Google.