Closed Beta Update — Bamboo

Harry Lowther
getbamboo.io
Published in
3 min readDec 14, 2018

Bug squashing and lessons learned…🐞🤓

Testing leads to failure, and failure leads to understanding. — B. Rutan

First off we’ve been overwhelmed by the quality of our testers and the generous amount of time they have spent reviewing and providing feedback on the Bamboo Beta app. For this, and more we thank you again for being a massive part of the final product and couldn’t be happier with our little community come soft launch.

(Which by the way really is just around the corner Woohoo! 🙏)

What are the numbers?

We released the app in blocks over 4 days from 05/11 – 08/11

  • Each block of testers
    = 50 people
  • Total # of Testers Given Access to Beta
    =
    200
  • # of Testers who Launched the application
    = 200 (Nailed it 🙌)
  • # Testers who never returned
    = 12 (That is less than 6% which is awesome! 😇)
  • Ave. # of Application Launches per day
    =
    79
  • Total # of launches since the testing began
    =
    3131
  • Average time spent on the app after on-boarding
    = 1 minute 49 seconds (So you can keep going about your day with brief check-ins 🤗)
  • App Crashes
    = 61 (Sorry but also thanks 😘 testers — a majority of these on the pin code)
  • App Version updates since the release of the beta
    = 23 (Version 242–265: each update contains multiple fixes and alterations to the previous version and these were in large part a result of what our testers found 🕵️‍)
  • Critical Issues/Bugs Found
    = 3/3 Squashed!
  • Minor/Trivial Bugs reported
    = 15/52 fixed (Need more bug spray! 🐞)
  • Unique feedback points
    =
    100+ (Our testers have really been throwing themselves into the app and their feedback, we couldn’t be more thrilled 🤩)
Updates based on feedback from all of you.

Feedback

Top 3 feature requests from our testers?

  • Recurring Investment Contributions
    ‘So that if I’m not spending I’m still investing’.
  • Buy Specific Asset Capability
    ‘Future Potential’
  • Setting an Investment Goal
    ‘Because how else can you score?!’

So what have we learned from our amazing community of testers so far?

  1. That our on-boarding flow required some simple UI changes to help streamline new users.
  2. A high load of new users slowed the navigational capabilities of the app.
  3. The length of time for on-boarding was just over 2 minutes with an average of 40 actions before completion.
  4. The passcode screen was a bit of an issue for many users causing the app to crash with noticeable ‘lag’ on entering the final digit.
  5. Everyone (ourselves included) was sick of seeing the initial pop-up beta testing screen 🙇‍
  6. We had some insufficiencies in regards to connecting bank accounts both in regards to UI bugs and reassuring the testers of our security measures in place i.e.
    - We NEVER record or store your bank details
    - We only monitor your bank account transactions for round-up opportunities
    - We use 256-bit AES data encryption
  7. Our community has some incredibly insightful thoughts and ideas to improve the functionality and user flow of Bamboo 👏

Summary

Our goals for tester participation and feedback quality was not only met but surpassed our expectations. We learned a lot and now understand more than ever what is important to our community and how we might pursue and prioritise future iterations. As a result of the response we received, we feel confident the product is on track to excite and delight our close-knit community and facilitate a new wave of blockchain participation.

Thanks again to our testers and to everyone who has supported and continues to support Bamboo. And with the holiday season upon us, we would also like to wish you all a wonderful and joyous time spent with friends and loved ones. — Bamboo Team

--

--