4pBot 0.2 Mini Evaluation

We launched 4pBot live to the public last week. I’ve been carefully following how users have reacted to the bot, along with some of the feedback from our users.

This is a summary of feedback from our users, and our own observations.

The Good

• People seem to love 4Pbot! We’ve had over 160 unique users, most of whom have finished at least 1 conversation with 4Pbot.

Yay for users!

• Our Facebook posts have received a lot of attention, and we now have credibility in private Facebook groups to promote 4pbot to over 20,000 beneficaries
• Feedback from 4Pbot users seems positive, with ~90% of feedback being a 😀, as opposed to a 😐 or 😦
• One of 4Pbot’s core features, the ability to make anonymous reports, has been used over 30 times.

The Improvable

• 4Pbot relies on users to know their zip code in order to look up information such as predicted payout dates. Many users don’t know their zip code, and get rather stuck.
• When first using 4Pbot, people don’t always want to give us their phone number (fair enough).
• 4Pbot’s error handling is quite simple at the moment, leading to confusing and circular conversations. We need to fix this ASAP!

What’s Next

• We might’ve made a bit of a splash to begin with, but we need to work on ways to retain our users, and keep on growing our user base. This means fixing the above bugs, and building out 4Pbot’s core features.
• Chatbots are quite new to our users. We have needed to guide some users through some of how 4Pbot works, which is currently a little tricky and archaic. We need to implement human-in-the-loop, to allow 4Pbot to do a little more hand holding while we iron out these kinks.
• One of 4Pbot’s value propositions is to collect and aggregate data on the performance of the 4Ps welfare program. We will be working on our first report with some of the data we have already gathered from 4Pbot, and develop a process for how we might go about this at scale.

Stay tuned for more updates! You can check out more of what we’re working on at Vessels Tech, or on 4PBot’s site here.

If you enjoyed this post, or have any suggestions or questions, let me know in the comments. If you liked this post, give it a ❤️ or a 👏, or whatever you crazy kids are calling it nowadays.