Recreating a 70-year love story frame by frame
Discover how filmmakers and Google DeepMind used AI to recreate a couple's unrecorded past in the short film "Love, Rendered."
A documentary, titled "Love, Rendered," employs artificial intelligence to assist a couple with memory loss in re-creating a cherished, yet unrecorded moment from their past. By merging image restoration with performance capture, the team replicated the couple's youthful appearances onto their present selves, constructing a realistic visual memory.
This project demonstrates the potential of technology to assist those experiencing fading recollections, acting as a virtual paintbrush to maintain cherished memories. The documentary focuses on Burt and Ethelle Shatz, a married couple of over seven decades, as they endure Burt's cognitive decline. They recall a pivotal encounter that occurred at a student co-op in Cleveland, a memory unrecorded by any photograph or film.
This unrecorded memory necessitated a unique reconstruction process. The film's technical lead, the author, had a personal connection to memory loss, as their grandfather experienced stroke and memory loss before passing. Witnessing the last days of their grandfather, the author wanted to explore if this technology could foster deeper connections with family members.
The documentary was directed by Academy Award-nominated filmmaker Liz Garbus, produced by Dan Cogan and Darren Aronofsky, and developed in collaboration between Google DeepMind and Primordial Soup. Both Garbus and Aronofsky were intrigued by the resilience of memory. Inspired by their experiences with reminiscence therapy, the team embarked on recreating Burt and Ethelle's unrecorded memory.
They partnered with the film's technical team to guide the AI technology, ensuring emotional accuracy. The film's creators utilized a dual technical approach to bridge the gaps in Burt and Ethelle's missing details, intertwining their past and present. This approach generated a "memory" that felt authentic to the couple. The documentary offers a glimpse into their love story, frame by frame, and provides guidance on restoring old photos using the Gemini app.
Written by urgent.news from Google AI Blog's reporting — not their text. Machine-written — may contain errors; check the original before relying on it.
