Forget Me Not

AI-Generated Characters as Digital Mementos

Chemiczkamichalina
HCAI@AU
4 min readMar 17, 2024

--

Image by MidJourney (v6).

In an era where pixels meet tradition, the MIT Media Lab brings us “Living Memories,” a fusion of history and technology allowing conversations with the likes of Leonardo Da Vinci or your ancestors, all thanks to AI magic.

(A&B) The user interface of living memory of Leonardo Da Vinci.

Every culture treasures the act of remembering. “Living Memories” taps into this, transforming old letters and journals into digital friends. Picture chatting with Da Vinci about the secrets behind his inventions, or learning family recipes from your great-grandma, with just a click!

To make these virtual interactions feel real, MIT wizards combined two powerful AI spells. First, the all-MiniLM-L6-v2 model dives into texts, fishing out essential insights. Then, GPT-3 takes the stage, turning these insights into lively chats. It’s not just about mimicking; it’s about capturing the soul of the conversation, making Da Vinci’s witty remarks or Scott’s adventurous tales come alive.

The foundation of this system lies in its unique combination of two advanced AI models: the all-MiniLM-L6-v2 sentence transformer and GPT-3, a generative text model renowned for its text generation capabilities. This blend ensures that the digital personas created are not just echoed but truly resonate with the depth and style of the individuals they represent.

At the first stage, the all-MiniLM-L6-v2 model plays a critical role. It acts as a knowledgeable librarian, meticulously sifting through vast amounts of data — be it letters, journals, or any writings left behind. This model is adept at understanding and summarizing the key themes and nuances in these texts, ensuring that the groundwork for the living memory is deeply rooted in authenticity.

With the essence captured, the baton is passed to GPT-3, tasked with the art of conversation. GPT-3, with its remarkable language understanding and generation capabilities, transforms the summarized themes and nuances into dynamic, engaging dialogues. What makes GPT-3 stand out is its ability to adapt its responses not just in content but in style, mirroring the linguistic nuances of the person being portrayed, be it Leonardo Da Vinci’s insightful musings or Captain Robert Scott’s adventurous tales.

The architecture of the AI-generated living memory model.

The goal was clear: not just to animate texts but to weave the essence of personalities into each chat. This tech duo ensures the chatbot foundation is genuine, and sourced straight from history, letting users dive deep into meaningful exchanges.

Crafting Living Memories was about striking a delicate balance — making advanced tech feel as comfy as your favorite app. This approach promises a deep dive into history and personal legacies, making learning about the past as enjoyable as scrolling through social media, but way cooler.

A study involving 90 participants revealed that interacting with Living Memories, especially when complemented with reading about the historical figure, significantly enhances learning effectiveness and motivation. This suggests that Living Memories could serve as a powerful educational tool, adding depth and interaction to the learning experience.

Innovative? Absolutely. But without a moral compass, we risk creating digital Frankensteins. It’s crucial that these AI companions stay true to their origins and don’t start spouting invented facts. Regulations are a must to keep this tech on the noble path.

Imagine a future where your digital mentor doesn’t just text but can also talk and gesture like a human. The MIT team dreams of such immersive experiences, though they caution us to tread carefully, ensuring these virtual beings remain respectful tributes to their real-life counterparts.

“Living Memories” is not just a tech marvel; it’s a bridge to the past, making history and heritage accessible in a fun, interactive way. As we venture into this new territory, it’s all about celebrating lives and legacies, ensuring the digital realm enriches our understanding of the human experience

Reference

  • Pat Pataranutaporn, Valdemar Danry, Lancelot Blanchard, Lavanay Thakral, Naoki Ohsugi, Pattie Maes, and Misha Sra. (2023). “Living Memories: AI-Generated Characters as Digital Mementos.” In Proceedings of the ACM Conference on Intelligent User Interfaces (IUI ’23), Sydney, NSW, Australia. ACM, New York, NY, USA, 13 pages.

--

--