iPhone Portrait Mode, 10 Years In
Speaking of Johnnie Manzari, he wrote a post yesterday marking the 10 year anniversary of Portrait Mode: Initially, Portrait mode was seen as a giant math problem. You’d do disparity calculations on the two sensors and output a depth map. The problem was this approach feels and looks digital; it feels fake. In areas without texture, it’s impossible to do this calculation. In areas with ultra fine…
Ten years ago, Apple introduced Portrait Mode to the iPhone camera, a feature that required overcoming significant technical challenges. Initially, engineers struggled with disparity calculations using the dual-camera setup, resulting in a digital and artificial appearance. The approach failed in areas lacking texture and struggled with complex details, leading to poor transitions and lengthy computation times.
To address this, one proposed solution was to reduce the amount of bokeh to make the effect less obvious, but doing so would defeat the purpose of the feature. The ultimate solution lay in striking a balance between artifacts and blur, an elegant trade-off that came after much trial and error. Apple drew inspiration from painting, where the eyes are crucial; hence, they ensured the eyes remained accurate in the captured images.
Ten years later, Portrait Mode remains a testament to Apple's ability to blend history, art, and computational science, creating an effect that continues to captivate users.
Written by urgent.news from Daring Fireball's reporting — not their text. Machine-written — may contain errors; check the original before relying on it.
