An independent survey of over 500 chatbot owners and developers by text analytics specialists and Warwick spinout Warwick Analytics reveals the majority are not satisfied with the performance of their chatbots and say human validation is key.

The research shows that 59% of businesses who have a chatbot are unsatisfied with its performance.

551 professionals involved in the development or management of chatbots were surveyed by Warwick Analytics.

When discussing the technical challenges respondents faced trying to improve their own chatbots, the most common issues were improving containment rates (90%), reducing errors (83%), and developing the responses for the chatbot (79%).

More significantly, an overwhelming 93% believed that human validation and/or curation was important to maintain and improve the performance of their chatbots.

Dan Somers, CEO of Warwick Analytics shared:

Achieving the right level of human-in-the-loop input is key for chatbot owners and managers. Human validation is required for accuracy and improvement but if too much is required then a business may as well have a human service desk. It’s all about finding the right technology that minimises the human intervention required but still increases accuracy. Our software PrediCX does exactly that.”

In addition, 21% of respondents who were yet to deploy a chatbot said it was because the performance of chatbots wasn’t acceptable in their opinion.

Warwick Analytics provides machine learning technology to help maintain and improve chatbots using a human-in-the-loop platform called PrediCX accessible via an API. The company’s software is based on sophisticated computer algorithms, developed at the University of Warwick over a decade of academic research.

For more information, visit the Warwick Analytics website.