Artificial Intelligence Offers a New Way to Find Your View in the CMA Collection
By Anna Faxon and Haley Kedziora, Digital Project Managers
Art is one way people reflect and shape the world they see, and the Cleveland Museum of Art has a new way to match your view to views created by some of history’s greatest artists.
The CMA’s Digital Innovation team has launched ArtLens AI: Share Your View. This interactive tool on the museum website and on Twitter matches what you see in your world to art from the CMA’s remarkable collection.
This easy point of entry into the CMA answers the fatigue of people learning new technologies to stay connected to friends, family, and co-workers. We also wanted to give the community a resource in which— without previous knowledge of history or art theory — someone can make visual connections between their world and a work of art at the click of a button.
The reverse image search tool uses Artificial Intelligence (AI) to recognize the shapes, patterns, and objects in your own photos to find surprising and delightful matches from the CMA’s encyclopedic collection. The tool can even recognize famous architecture in your photo.
When making a match on the website, you can shuffle through other close matches, download a composite image to share with your friends, or add the image to our visitor gallery. Links to the CMA’s Collection Online offer you more than 36 fields of metadata about a work of art, such as an artist biography, citations, and curator videos. On Twitter, attach a photo or an image to your tweet and mention @ArtLensAI to share your view. The Twitter bot will automatically reply with a matching artwork.
Using Machine Learning and the open source vector similarity engine Milvus, the CMA’s Digital Innovation development team created the AI tool with Design IO, who had previously collaborated on the museum’s ArtLens Studio in 2016, and Jeff Schuler, a partner who leads the CMA team on website development. The new initiative builds on AI used in the museum’s on-site ArtLens Exhibition to read emotion and match a visitor’s face to portraits in the CMA’s collection.
We hope this will be another source of inspiration and fun in these uncertain times. We know that people need new, creative, and easy ways to engage with art. The CMA has grown as a digital museum during the COVID-19 pandemic, with many new gifts to the community. But CMA staffers feel the “Zoom fatigue” of remote work and video conferencing as much as anyone else after six months of self-isolation. Share Your View is one answer to the cautious steps we all are taking into a hybrid experience of life online and life in safe physical spaces.
ArtLens AI: Share Your View can help students, teachers, and parents feeling drained by the continuation of virtual learning. Schools in hybrid mode still rely on video calls and online platforms for classroom engagement. College and high school students are learning from their homes and dorms, without access to on-campus resources. The CMA’s education team has already begun to share this tool as a way to spark conversations about composition, palette, and pattern. Placing an artwork side-by-side with a contemporary view creates new comparisons and opportunities for critical thinking.
Since the launch of ARTLENS Gallery in 2012, the CMA has been a leader in creating digital connections to art. This year we have added many new curator videos for online viewing and created the ArtLens for Slack app so workplaces can share a daily moment of discussion and interaction centered around artwork in the museum’s Open Access collection. We hope the new AI feature will help you find yourself in some surprising and inspiring places inside some of the most beautiful art in the world.