Reach new heights of laziness by burning tokens to let an AI tap your smartphone screen for you
Nothing will ruin your faith in humanity like an AI that operates your smartphone slowly, struggles with basic tasks, and can charge you for it
The latest innovation in digital laziness is the launch of Opposable, a tool that allows an AI to take over your smartphone's screen for you. This seemingly excessive convenience app enables users to let a computer agent, via a companion device, perform tasks such as updating calendars, starting timers, and enabling dark mode. Opposable's creators claim that the AI "gives you thumbs" to tap, swipe, and type on your Android or iPhone device, sparing you the tedium of using your own hands.
The AI agent utilizes accessibility services to inspect the screen, with visual input provided by screenshots. A vision-language model, GUI-Owl 1.5 2B, interprets the images to determine where the AI needs to tap on the screen to carry out the user's requests. While some tasks, like setting alarms or switching Wi-Fi, are handled by fixed code, many others rely on the AI model.
However, Opposable's practicality is questionable, as its speed and accuracy are both subpar. Examples of tasks executed using Opposable have shown that it takes much longer and costs significantly more than simply using your hands or a virtual assistant like Gemini or Siri. Despite the tool's poor performance, users are invited to sideload the app and grant it access to read and interact with the screen through accessibility settings, despite the inherent security risks.
Opposable's website warns of potential security disasters, but still encourages users to experiment with the app.
Written by urgent.news from The Register Software's reporting — not their text. Machine-written — may contain errors; check the original before relying on it.
This story
This is one outlet's version. Read the fullest account.
