How to Use the Chatbot Reporting
Introduction

Comm100's Chatbot reporting serves as an important tool for measuring the achievements of the Chatbot. It also helps you find out areas where your Chatbot needs improvement.  

Reporting provides information on various Chatbot features and functionality based on certain metrics. You can use it to improve the Chatbot’s performance by providing actionable goals to it.   

Types of reports and their use

Comm100 provides Chatbot Reporting for the following features:

Chats & Tickets

The Chats & Tickets report provides information on the number of chats and tickets handled by the chatbot. You can use this report to check the utilization of the chatbot in comparison to the agent. 

The report includes the following metrics: 

  • Bot Only Chats & Tickets 
  • Chats & Tickets from Bot to Agent
  • Percentage of Bot Only Chats & Tickets
  • Bot Only Chats
  • Chats from Bot to Online Agent 
  • Chats from Bot to Offline Message
  • Bot Chat Time
  • Agent Chat Time 

 

Metrics 

Description 

Bot Only Chats  

Helps you get the number of chats solely handled by the bot. It excludes the chats transferred to online agents or offline messages. 

Chats from Bot to Online Agent 

You can find the number of chats that were transferred to online agents. These chats needed human intervention and could not be handled successfully by the bot. Analyze where the bot needed a human agent to take over. This can be used to improve intents which will improve the bot’s performance. 

Chat from Bot to Offline Message 

Displays the number of chats where the visitor chose to talk to an agent and left an offline message as no agent was available.  

Bot Chat time 

Displays the total time taken by bot on all chats and includes the chats where visitors left offline messages. 

Agent Chat time 

Displays the total time taken on the agent involved chats, includes all chats transferred from bot to agent. 

 

Answers

The Answers report provides insights into answers in intents. You can analyze this report to improve answers in your intent library. 

The report includes the following metrics: 

  • Answers 
  • High Confidence Answers 
  • Possible Answers 
  • No Answers 
  • Percentage of High Confidence Answers.  

 Answers.png

 

Metrics 

Description 

Answers 

Displays the total number of answers using this metric. It is calculated as a sum of all Possible answers, High Confidence answers, and No Answers. 

High Confidence Answers 

Displays the number of High Confidence Answers that the chatbot provides to the visitor. 

Possible answers 

Displays the number of times the chatbot provided a Possible Answer to the visitor’s question. 

No Answers 

Enables you to view the number of times your chatbot could not provide an answer to the visitor. 

Percentage of high confidence answers 

Displays the percentage of high confidence answers. 

This is calculated as a percentage of High Confidence Answers over total Answers provided by the chatbot to your visitor. 

  

High Confidence Answers

The High Confidence Answers report helps you to gain insight into the accuracy of High Confidence Answers and adjust the score accordingly. 

Hight Confidence Answers is based on the number of Helpful and Not Helpful ratings given by visitors on answers provided by the chatbot. 

The report includes the following metrics: 

  • High Confidence Answers 
  • Helpful Rate 
  • Not Helpful Rate
  • No Rate  
Note: The High Confidence Answers Report only counts data from the Live Chat channel. 

 

 

Metrics 

Description 

High Confidence Answers 

Displays the total number of High Confidence Answers. 

Helpful 

Displays the number of times users rated High Confidence Answers given by chatbot as Helpful. 

Not Helpful 

Displays the number of times users rated High Confidence Answers given by chatbot as Not Helpful.  

You can use it to analyze the related intents, which did not help the visitor and improve them. 

No Rate 

Displays the number of High Confidence Answers that were not rated by the users. 

  

Rating

You can use the Rating report to check the visitors’ satisfaction on the overall chat experience provided by the chatbot, on a scale of 1 to 5.   

The report includes the following metrics: 

  • Rating Times 
  • Rating scores: Score 5, Score 4, Score 3, Score 2, Score 1 
  • Avg. Score 

 

Metrics 

Description 

Rating Times 

Displays the total number of times a visitor rated the chatbot. 

Rating Score 

Displays the number of times the chatbot received each score. 

Rating scores can vary on a scale of 1 to 5. 

Avg. Score

Displays the average of all rating scores that your visitors gave to the chatbot. 

 

Chatbot & Agent

The Chatbot & Agent report helps you compare chatbot and agent performance in terms of workload, efficiency, and visitor ratings.  

The report includes the following metrics: 

  • Chats 
  • Avg. Chat Time 
  • Avg. Rating Score 
  • Total Chat Time 

Reporting 1.png 

Note: This report only counts data from the Live Chat channel.

 

Metrics 

Description 

Chats 

Compares the total number of chats handled by the chatbot with the agent. 

Avg. Chat Time 

Compares the average chat time of the chatbot with the average chat time of the agent. 

Avg. Rating Score 

Compares the ratings of the chatbot with the ratings of the agent. 

Total Chat Time 

Compares the total time taken by agents with total chat time taken by the chatbot to handle all chats. 

Chatbot Usage

The Chatbot Usage report provides data on the number of times any category and intent are used. You can recognize the most used categories and intents of the chatbot and improve them.  

You can view the report by Intents, Time, and Bot. 

Example 1, viewing the report based on intents for the bot. 

Chatbot Usage 1.png

Click on each of these categories and check the number of times each intent is used.  

Example 2, viewing the report based on time for the bot. 

Chatbot Usage 2.png 

Top Intents

The Top Intents report is used to view the top used Intent and Category in a period for a Chatbot.

Top Intents.png

Collected Leads

The Collected Leads report provides the number of leads collected by Chatbot. You can view the report By Time and By Chatbot. 

By Time:

By Chat Bot:

 

Booked Meetings

The Booked Meetings report provides the number of meetings booked by the Chatbot. You can view the report By Time and By Chatbot. 

By Time:booked meetings by time.png

By Chatbot:

booked meetings by chatbot.png

Reading the reports

You can read and analyze each report separately from various perspectives. You can analyze the data for All channels or individual channels, and can Filter the report by Site, Campaign, or Bot.  

You can choose the Time Range for which you want to check the report and Display the same by Hour, Day, Week, Month, 24*7 or Half-hour. Study each report using the metrics available in it. 

Note: Filter varies for each report and you can apply them according to requirements. Also, the metrics in the reports vary with the channel (Live Chat, Ticketing & Messaging) that you select.

 

 

The Download button allows you to download the report in a CSV file that can be shared with others.  

To check the reports, follow these steps: 

  1. Log in to the Comm100 Control Panel.   
  2. From the left navigation menu, go to Reporting > Chatbot
  3. Then you can choose any of the available reports that you want to study and proceed.