Stylefinder: Bringing AI To Brick-and-Mortar Stores

The first concept from the Myplanet Concepts Team, powered by IBM

May 2, 2017 · 4 min read

Project duration: 20 days
Technologies used: IBM Visual Similarity Search & Visual Recognition

The Concepts Team at Myplanet explores projects focused on sparking innovation in the workplace. With a keen interest in emerging technologies, our work maps trending technologies to real-world use-cases. For our most recent concept, we tackled the retail workplace. Using Watson’s IBM Visual Similarity Search microservice, we prototyped an AI-driven online style finder to identify customer tastes and facilitate more meaningful in-store interactions between customers and store associates.


Fashion is a deeply personal choice. Apparel purchasing decisions are made on an emotional level and the abundance of options only adds to the burden of choice for consumers.

Using machine learning, how might retailers better understand apparel tastes to help customers make more personally-relevant purchasing decisions? And how can we bring the benefits of the online commerce experience back into the bricks and mortar space? We created the Stylefinder to explore these questions.

Solution: Stylefinder

“We’re currently exploring a visual recognition theme in our broader exploration of how we can build more intelligent interfaces that empower employees by shaping data effectively. In the case of retail technology, it’s not enough simply to use AI microservices to create a gimmick to get customers into a store. We need to find ways to drive real insights for the employees to improve the workplace.”

— Erik von Stackelberg, Creative Director at Myplanet

The solution supplements (or in some cases, substitutes for) a store associate’s product knowledge and ability to provide effective recommendations, tailored to the customer.

Stylefinder User Flow of connecting a Pinterest account

Key Flow

With the pursuit of a few different approaches, the final working prototype uses IBM’s image similarity matching tool to analyze a user’s social profile. In this case, Pinterest serves as the source for Stylefinder’s data. As a popular social platform that allows users to express their aspirational style sense, we felt Pinterest had particular relevance to the target user group and use case.

Stylefinder in action

Once the Pinterest boards are analyzed, the output builds a profile of the user’s style affinity, with appropriate inventory recommendations. From there, users can further refine their style profile using the slider adjustments and subsequently fine-tune the system’s fashion recommendations.

Stylefinder’s adjustable sliders

Additionally, deeper system learning would be encouraged by using additional manual inputs. By giving users the ability to like or “X” out certain recommendations, the system learns from real user inputs that either confirm or negate the data set. By choosing to “X” a particular item, users teach the system what does not represent a specific style. In essence, we crowdsource additional data around apparel items, thereby surfacing things that are actually not popular or representative choices for fashionistas who identify with a certain style.

Stylefinder: Special icons let users express whether or not the selections match their tastes

A Personalized Omnichannel Experience

With the aim of solving for workplace challenges, we wanted to extend the story of an AI-powered fashion recommender to improve the retail experience of brick-and-mortar stores. To do this, we built in a capability that would allow users to reserve their preferred items in a nearby store, allowing them to evaluate for fit, materials used, and other more tangible considerations outside the parameters of “style”.

Not only does this give the customer a sense of empowerment and ownership over their choices, but it allows retailers to leverage the consumer insights around a customer’s personalized style profile to make more compelling in-store recommendations, bolstering opportunities for sales.

Employee view of a customer’s style profile: Employees are are able to see reserved items made by customer and any related fashion recommendations.

What’s Next

For the Stylefinder concept, we had the pleasure of having Vishnu Hari, Client Technical Solutions Consultant from IBM, on site. Vishnu, who has previous experience in fashion identification, helped identify some of the constraints and opportunities technologists face when applying visual recognition technologies to the fashion industry.

“Watson Visual Recognition (WVR) is able to distinguish between a dress style that’s preppy, versus one that’s more bohemian. This brought immense value to the team in distinguishing between the often blurry lines that separate fashion affinities. WVR was indispensable in helping the team build structure from a multitude of fashion images.”

— Vishnu Hari, Client Technical Solutions Consultant, IBM

If you’re interested in joining the Myplanet team or learning more about what we do, check us out online here.

Myplanet Musings

Thoughts, ideas, insights, and more from the Myplanet team.

Medium is an open platform where 170 million readers come to find insightful and dynamic thinking. Here, expert and undiscovered voices alike dive into the heart of any topic and bring new ideas to the surface. Learn more

Follow the writers, publications, and topics that matter to you, and you’ll see them on your homepage and in your inbox. Explore

If you have a story to tell, knowledge to share, or a perspective to offer — welcome home. It’s easy and free to post your thinking on any topic. Write on Medium

Get the Medium app

A button that says 'Download on the App Store', and if clicked it will lead you to the iOS App store
A button that says 'Get it on, Google Play', and if clicked it will lead you to the Google Play store