The “Siri syndrome” or what prevents companies to dive into AI and chatbots

According to Gartner, 90% of enterprises are investigating in chatbots, but only 4% have them up and running. The main reason for this is the misconception on what chatbot intelligence actually is. Our ultimate test of a chatbot intelligence has summed up to be a simple question — What’s the weather? Clearly a Siri syndrome.

Hristo Borisov
Progress NativeChat
7 min readNov 13, 2017

--

How many times have you called your General Practitioner to book an appointment and midway through the conversation you asked — What’s the weather? Unless you are a loco searching for mental health care services, the odds are not very high.

Building chatbots with Darvin.ai for some of the biggest healthcare and financial institutions we are observing an interesting phenomenon. People are often “testing” and “judging” the intelligence of a chatbot midway through a conversation by asking a series of unrelated questions such as What’s the weather? How old are you? What time is it? What are you? Who is your master? How much is 1+2?

And it’s no surprise. The dream for AI fueled by years of research and investments by some of the largest technology companies in the world is reaching a pivotal point. Our imagination is already expecting a super-knowledgeable and sensitive personality in the face of AI that is enriching or replacing a lot of processes served by people today. A story in our minds already augmented by multiple fictions and movie plots like Her. I call this the Siri syndrome — our eagerness to check Are we there yet?

We are sort of.

According to Van L. Baker from Gartner 90% of enterprises are investigating in chatbots, but only 4% have them up and running. The intent usually is to reduce cost by reducing headcount, but current investments are far from a meaningful ROI.

The current state of AI and chatbot yields very good ROI for businesses that invest in what we call transactional chatbots. To understand why, we need to understand the subtle, but yet very important difference between transactional and knowledge chatbots.

Transactional vs. Knowledge chatbots

The difference between a knowledge bot (think Siri) and a transactional chatbot is that the latter is optimized to execute a limited amount (4 to 6) of specialized processes that replace the need to talk to an expert or use more complicated UIs such as mobile apps or websites. While the knowledge chatbot supports thousands of processes and in some cases is able to make decisions for you.

Transactional chatbots are trained on top of structured data and can do a set of limited operations. Think of what a bank operator can do for you over the phone: verify your identity, block your stolen credit card, give you the working hours of nearby branches and confirm an outgoing transfer. Using this approach, we built a transactional chatbot for a Hospital that reduced by 30% the workload of the contact center. This is equivalent to 1.5 full-time employees working 24/7.

On the other hand, knowledge bots are helping you both make a decision and execute it. In order to be able to “make a decision” the chatbot is usually trained with a vast amount of unstructured and structured data, and is trying to produce a response as an expert. To be effective, a knowledge bot can execute hundreds of processes for you. Think of how many things Siri can do for you.

IBM Watson and its work with MD Anderson, a major cancer-treatment center that’s part of the University of Texas system is another good example of a knowledge bot. With a heavy price tag of $62 million dollars, the Oncology Expert Advisor (OEA) was supposed to use artificial intelligence (AI) to expedite physicians’ decision making when treating malignant tumors. However, the biggest challenge of a knowledge bot is to determine whether it works. And it usually depends on who you ask. MD Anderson ditched IBM Watson in February 2017 after giving $39.2 million to IBM and $21.2 million to PricewaterhouseCoopers, which was hired to create a business plan around the product. In a conversation with Forbes, IBM said that

“The OEA’s recommendations were accurate, agreeing with experts 90% of the time. [It] was a success, and likely could have been deployed had MD Anderson chosen to take it forward”.

Here is a similar response from the founder of Siri at Fortune after being provoked whether Siri actually works.

“I completely disagree with people who say it doesn’t work very well, you don’t launch a product that isn’t in the 90th percentile of working if you’re using it properly”

The Siri syndrome or our constant drive for true artificial intelligence is what prevents executives and product leaders to imagine the use of chatbots as a way to improve a given customer experience 10x using conversational UI.

Executives and product leaders are stuck to think of scenarios for knowledge chatbots that result in multi-million project flops or anxiety to make the next step.

So, what’s the solution? Instead of completely replacing the need to hire an expert by substituting it with AI that can also perform second grade math, executives need to think how they can optimize 70-80% of the workload for some of their front-line employees by using transactional chatbots.

This approach is already gaining competitive advantage for many companies in the Financial Services, Healthcare and Automotive sector which tend to have structured processes suitable for transactional chatbots that are currently performed by full-time employees.

But before companies can start looking for a chatbot solution on the market, there are some best practices that we recommend.

Look for a 10x improvement

People tend to quickly absorb a new buzzword before they fully understand the practical use and implications of it. We use every new and emerging technology as a Swiss Army knife for solving any kind of problems. As a technology person, I have seen how docker was used as a way to scale every software — “Just put it on Docker and it will scale.” or how blockchain is used to democratize trust today.

Before you use a new technology to make a revolution on the market, disrupt it, democratize it or simply come up with the next Uber of the Airbnb business, you need to find a practical use that outpaces 10x current market alternatives. The concept of switching costs for a user to a new channel is very well explained by Peter Thiel in Zero to One.

To get your customers to use your new channel, try to find a painful process that you can improve 10x. Booking doctor appointments with a chatbot instead of waiting on the line for an operator is what helped Dr. Shterev Hospital get their customers to appreciate a new channel.

Simple not stupid

One can ask — where is the intelligence with transactional chatbots then? How can you engage a user with a chatbot that sounds like an answering machine or a boring IVR?

Developing a chatbot that is able to understand natural language and help a customer perform a set of operations tied to enterprise systems might not be trivial. If you have a banking chatbot can do 5 operations each of which requires between 3 to 5 steps to complete, you get a set of 20 interactions that your chatbot needs to support. And this doesn’t include edge cases where a user input is invalid or the user switches his intent midway through the conversation. Microsoft, Amazon, and Facebook already provide state of the art Natural Language Processing (NLP) developer tools to help your bot understand user intents, but you need some real intelligence that controls the conversation flow beyond NLP.

In my previous blog, Anatomy of a chatbot — how much does it cost to build one, we estimated that 90% of the budget for a transactional chatbot is spent on developing this conversational intelligence.

With Darvin.ai we have created a technology called Cognitive Flow that is helping developers build intelligent chatbots using declarative programming instead of defining decision trees in code which is 15 times faster and 2 times cheaper than current market alternatives.

Where to start

Even if you are observing how competitors are swiftly gaining a competitive advantage by just using the AI, ML, Deep Learning and other trendy words in their newsroom articles, there aren’t many places for you to start. Using chatbots to interact with customers is a strategic decision, and needs to be supported by the top. However, the product leaders of the majority of the companies we work with don’t have an easy way to make a case for such investments as it either involves a dedicated development team and a hefty price tag.

That is why with Darvin.ai we introduced a way for companies to purchase a Proof of concept implementation for a fixed price where any company can receive a proof of concept chatbot for less than 2 weeks. The proof of concept chatbot is always integrated and working with all enterprise systems and is ready to be used with up to 200 customers for 3 months.

If you want to learn more on how to get started with chatbots and have a proof of concept build quickly, simply talk with our chatbot on Darvin.ai who can help you sign up an appointment with our team!

--

--