AirPod cameras will detect people, and warn about image capture with a status light

Apple is developing camera-equipped AirPods, as evidenced by a hidden macOS framework called AccessorySensorManager that manages sensor data when the devices connect to a Mac. This framework has revealed several key features of the upcoming AirPods. The left and right earbuds are equipped with individual camera sensors that generate synchronized RGB still images, each up to 1 megapixel in resolution.

These images share the same frame IDs, providing a visual perspective from both angles, although this doesn't preclude the inclusion of other sensors like infrared cameras.

The cameras in the AirPods are designed for periodic image capture rather than video recording; they take internal still frames for processing by Visual Intelligence. In active mode, the cameras capture 640x640 images and return processed 1024x1024 images, translating to approximately 0.4 megapixels of sampled image data with a slightly higher 1 megapixel output frame.

Active mode is likely triggered by the user via Siri, while passive mode involves capturing 320x320 images that can output 320×320 or 512×512. This mode is intended for background environmental awareness, detecting conditions such as nearby speech, changes in audio, posture shifts, head rotation, and movement outside a predefined area.

AirPods also incorporate mechanisms to counteract continual head movement, including lens distortion correction, dual-camera calibration, and camera-to-motion sensor calibration. The framework can reject images affected by excessive movement or an obscured view, and some processing occurs directly on the AirPods, such as peripheral inference for detecting whether a person is in view.

Additionally, the AirPods are expected to have a capture indicator light, controllable remotely and adjustable in brightness, signaling to others when the devices are capturing images. It's important to note that the AirPods showcased in a demo video were a camera-equipped version of the AirPods Pro 3 with a B790 codename, while the final product may differ.

Apple is reportedly working on a new generation of AirPods with cameras, codenamed B798, with a potential launch in 2027, possibly alongside the 20th-anniversary iPhone.