Product Teardowns at Yammer

Why we talk about a different product for an hour every Friday

At Yammer, we believe that product curiosity and product sense are two of the most important traits of a good PM, and that these skills must be continuously exercised. That’s why every Friday afternoon, the product management team and other interested folks from the design, research and analytics teams sit together for an hour and “tear down” an interesting mobile or web app. By “tear down”, we don’t mean “criticize”, but rather investigate and reverse engineer the thinking and experience underlying a product. This gives us inspiration to improve our own product.

In our teardowns, we don’t just look at directly competitive products, but instead cover a wide variety of apps. Some are new and exciting (recent examples include Quartz News and Facebook Live Video), while others address problems similar to the ones we solve at Yammer (typically in the communication and team collaboration space). Our goal is to build an understanding of how the app onboards and engages users, how it solves the users’ problems, and what the company’s underlying strategy seems to be. In addition, we always ask ourselves what we can take away from the app for Yammer. This might be something as simple as a nice UI interaction, to broader ideas around user onboarding and re-engagement.

How we do product teardowns

One of the first things we evaluate is the user onboarding experience, specifically, how the value proposition and the UI of the app are conveyed to the user. To do that, some of us sign up for the product during the teardown meeting, so we can experience the complete onboarding experience. We try to understand not only what we are seeing, but also why the product was designed as it was — what were the goals and which tradeoffs were made.

After the onboarding, we experiment with a broad a set of functionality of the product. We try to observe the interactions, whether we intuitively understand how the product is meant to work or whether we are constantly surprised by outcomes we didn’t expect. We also try to identify which UX paradigms the app adheres to and which it deliberately breaks. We look at whether interfaces are simple or complex. And lastly, we try to see how the product re-engages users (e.g., through push notifications, emails or an in-product notification mechanism).

In the second half of the teardown we turn to strategic questions: Why did the creators of the app build it? What goals were they trying to achieve, and what hypotheses are at the center of how they are trying to achieve it? Who will use this and why? What tradeoffs were made? Do we think the product is going to be successful and why? How could that be measured?

The teardowns have an open, ad-hoc discussion format where people call out things they noticed, or raise questions that come to mind. At the end of the hour, though, we wrap up the discussion by asking some pointed questions so that we can both capture a summary of what we learned and also think about what we will do with this information.

Specifically:

  • What did we like and enjoy about this product? What “wowed” us?
  • What questions and doubts do we have?
  • What other, broader observations did we make?
  • What can we take away from this experience for Yammer?

Some examples

Quartz News

What we liked: The Quartz app does a great job at onboarding users. In exchanging messages with the app, users are educated about how the app works and can set their preferences, such as notifications. It is extremely effective, and users get to the content of their first news within 10 messages. We also really liked the simple, slick interface (with just two different screens). Also, using the messaging paradigm that users are already familiar with helps them intuitively grasp how the app works.

Questions we had: Does the fact that the user has to make a lot of yes/no decisions lead to “decision fatigue”, going against the “snacking” concept that the app promotes? How effective and quick are users at scanning the content of messages? Is that more or less effective than the traditional headline / article format?

Broader observations we made: Whether the conversational model is a viable way to deliver and consume this kind of content is a longer-term strategic question that will probably take a longer period of time to get the answer to.

Anchor

What we loved: We think that Anchor is positioned in an extremely interesting space, since there are a lot of “dead times” like commuting etc. where audio is the type of content that is easiest to consume. From a product perspective, we thought that the product onboarding and user education was great, getting the user to create their first introductory wave in the process. We loved how Anchor, as an audio centric app, makes extremely good use of sound throughout the app, using aural feedback for a lot of interactions.

Questions we had: We thought the product decision to encourage recording by holding the phone to your ear was interesting, and we were wondering whether that increases or reduces friction to record — especially given that so few (particularly young) people actually talk on their phones anymore.

Broader observations we made: The more traditional format in the audio space is podcasts, and one of the biggest challenges with podcasts is discovery of new content. For Anchor, being the content aggregator could help solve the discovery problem, but could also lead to challenges. For example, Twitter, which similarly aggregates short-form content, still has not fully solved the problem of discovering the most relevant content, particularly for new users.

Conclusion

Further reading

This is a great resource that explores user onboarding in a lot of depth: http://www.useronboard.com/

Jens-Fabian Goetzmann is a Product Manager at Yammer. Thanks to Philip Rose, Adrienne Trudeau, and cindyalvarez who helped get this article ready for publication.

We Are Yammer

Stories from the people who make Yammer happen

Welcome to a place where words matter. On Medium, smart voices and original ideas take center stage - with no ads in sight. Watch
Follow all the topics you care about, and we’ll deliver the best stories for you to your homepage and inbox. Explore
Get unlimited access to the best stories on Medium — and support writers while you’re at it. Just $5/month. Upgrade

Get the Medium app

A button that says 'Download on the App Store', and if clicked it will lead you to the iOS App store
A button that says 'Get it on, Google Play', and if clicked it will lead you to the Google Play store