I Let My Apple Watch Eavesdrop on My Conversations for 2 Weeks

Apple Watch Series 12 and Apple Watch Ultra 4 have introduced Audio Intelligence, a new set of features that allow the watch to listen in on conversations. Siri Recap generates summaries of what you've discussed throughout the day, while Live Rewind provides a transcript of the last 15 seconds of audio. This functionality is similar to AI-powered recording services, but it's built into the smartwatch and comes at no additional cost or subscription.

To use these features, you first have to opt-in and then choose when to activate them. It's completely optional, giving you control over whether you use them and how much. There are reminders if you forget the feature is on, but other people won't be alerted that the feature is active. Apple has implemented privacy safeguards for audio processing and deletion.

I've been testing Audio Intelligence in the WatchOS 27.3 (and iOS) public beta for two weeks. While Live Rewind doesn't have a lot of practical use, Siri Recap has been more helpful. However, it's still hit-or-miss, especially during conversations with multiple topics or distractions. Siri Recap provides high-level summaries, but it doesn't provide a transcript or identify who said what. It works best during dedicated meetings with a single conversation.

One positive experience was during an iPhone Duo live folding test where Siri Recap provided interesting facts I missed. However, it wasn't always accurate, like when it mixed up names and picking up the wrong kid during car-pool logistics. Siri also struggles to separate unrelated conversations, sometimes combining them into a single recap.

Overall, using Audio Intelligence has felt mundane but has its perks, even if it can be disturbing. It's up to the user to decide if they want to take advantage of these features and deal with the potential for confusion or privacy concerns.