Pixel 11 AI Features: Google’s Biggest Gemini Push Yet

Google's Pixel 11 showcases a new layer of artificial intelligence called Gemini Intelligence, designed to enhance various aspects of the phone. The Pixel 11, Pixel 11 Pro, and Pixel 11 Pro XL all emphasize Gemini's capabilities, with the device powered by the Tensor G6 chip and running the latest Gemini Nano model. Instead of solely focusing on a chatbot interface, Gemini is integrated across the operating system, providing timely, relevant information through glanceable cards within apps.

For instance, it can display flight details from Gmail when queried about an upcoming trip or suggest actions like saving events to Google Calendar. Google is pushing the boundaries of agentic AI with Gemini's multistep-task capabilities, which work with certain apps while allowing users to monitor, interrupt, or stop processes.

A notable feature is Rambler, a voice-input tool capable of understanding natural speech patterns, including filler words and corrections. This enables users to dictate messages with ease, as seen in tests where hesitant conversations were transformed into coherent text. Live Translate expands beyond text messages, allowing real-time translation of videos, podcasts, and voice messages using on-device AI.

Google demonstrated automatic dubbing for YouTube videos, enabling users to watch foreign-language content with AI-generated dubbing. Accessibility enhancements include sign-language-to-text support, allowing users to sign to their phone using the camera, with gestures translated into text through Gboard and Live Transcribe. This feature, initially available in American Sign Language, aims to facilitate web searches, messaging, document drafting, and interactions with Gemini for the deaf and hard-of-hearing community.

Magic Capture, Google's flagship AI camera feature, analyzes scenes continuously to select the best frames automatically, producing high-quality 12-megapixel photos. The feature can automatically crop images, reduce blur, and generate videos from the same capture session. Camera Looks provide preset visual styles, such as Natural, Shadows, or Velvet, with customization options.

Creator Suite offers video-related tools like an on-screen teleprompter, gridlines, and automatic video organization, catering to those who record short-form content. Finally, Instant Night Sight captures night-sight images up to 4.5 times faster than previous Pixel models, thanks to faster processing enabled by the Tensor G6 chip's upgraded image signal processor.