Gemini can now control Mac apps, but you still shouldn't let it
Google's Gemini can now control Mac apps and edit files on your behalf, but the convenience comes with security risks serious enough to make handing over that control a bad idea. Gemini and Apple Intelligence Google announced computer use for its Gemini Mac app on November 19, expanding the assistant's ability to complete multi-step tasks across local files, desktop apps, and websites. The…
Google is enhancing its Gemini app for Mac users with new computer use capabilities that enable control over desktop applications and web browsing. The existing Task feature, now referred to as Gemini Spark, previously allowed interaction with local files alongside connected online services such as Gmail and Google Calendar. The newly introduced computer use functionality empowers Gemini for Mac to perform multi-step tasks on your behalf, including navigating menus and filling out forms, all without requiring your direct input on the screen or cursor.
Gemini operates in an isolated background window, providing live preview updates within your chat interface while your primary workspace remains untouched. Users can halt Gemini's operations at any moment with a single click. Safety measures also include restrictions on sensitive actions like logins or financial transactions, requiring explicit confirmation before proceeding.
The utility of computer use becomes evident when tasks involve multiple desktop applications or websites that operate independently. By leveraging computer use, users can automate repetitive steps in the background, effectively saving time without sacrificing control over their devices. To activate this feature, users simply need to append "@Computer use" to their Gemini prompt.
Following the integration, users will find new "Desktop" app connectors within the Customize Connectors section, such as Blender and Autodesk Fusion, alongside existing integrations for Git and Obsidian. The computer use feature is set to launch in US English starting today for Google AI Plus, Pro, and Ultra subscribers. For further details, visit 9to5Google on YouTube.
Written by urgent.news from 9to5Mac's reporting — not their text. Machine-written — may contain errors; check the original before relying on it.
Also reported by 3 other outlets
- Gemini app for Mac adds computer use to control desktop apps 9to5google.com
- Gemini on Mac can now use your computer theverge.com
- ICYMI: Transfer your history from other AI apps into Gemini. blog.google