Google adds computer use capabilities to Gemini’s Mac app
Google LLC today released a new version of Gemini’s Mac client that can interact with other apps on the user’s computer. The feature is available in the U.S. on launch. It requires a Google AI subscription, which equips consumer Google accounts with a broader lineup of artificial intelligence tools. The offering also includes additional storage […] The post Google adds computer use capabilities…
Google has unveiled an updated version of its Gemini Mac app, allowing the AI assistant to interact with other applications on a user's computer. This new feature is available in the United States upon release and requires a Google AI subscription, which offers users a range of enhanced artificial intelligence tools, additional storage, and other functionalities.
The service includes a "computer use" command that users can employ when interacting with Gemini; for instance, a product designer could upload a vehicle sketch and request the AI to convert it into a 3D animation. Gemini identifies the necessary local app, constructs a project plan, and executes the work step-by-step. The assistant can manage workflows involving multiple tasks, and the results can be used to initiate subsequent projects.
Furthermore, Gemini can interact with both local applications and web services, enabling users to transfer data between webpages and programs running on their machine as well as between cloud services. The AI assistant operates within a background window, allowing users to continue working without interruption while the task is being processed.
Users can monitor progress through a preview pane in the chat window of the Mac client. Google has also incorporated controls to allow real-time feedback to Gemini during tasks. Privacy and safety measures are embedded in the system, giving users control over which apps Gemini can access and allowing them to monitor each step live.
Michael Friedman, Google's group product manager for the Gemini app, highlighted these features in a blog post. Competitors such as Meta's Muse and OpenAI's Dots also offer similar capabilities, and Google may look to match these rivals' cloud-based workflow hosting features in the future. Google could also expand Gemini's functionality further, such as introducing the feature to other operating systems and adding business-focused functionalities. OpenAI's Dots, for example, already includes business workflow automation features.
Written by urgent.news from SiliconANGLE's reporting — not their text. Machine-written — may contain errors; check the original before relying on it.
This story
This is one outlet's version. Read the fullest account.
- Google just gave Gemini the run of your Mac — three days after Apple tightened the rules thenewstack.io
- You can finally use Google Gemini to control your MacBook mashable.com
- Opting out of Gemini tracking? Google will still hold your data 20x longer theregister.com
- Google homepage rolling out AI-focused redesign that includes your Gemini chats [Video] 9to5google.com
- Google brings computer use to Mac, letting Gemini handle chores without hijacking your screen androidauthority.com
- Google adds computer use to Gemini for macOS, letting it work across apps, files, and the web in the background, available to US AI Plus, Pro, and Ultra users (Sarah Perez/TechCrunch) techcrunch.com