Create Validation Script

The Validation Script is used as a Bot Parent reference to check the desired Bot response results. If the bot response results are still not appropriate, then the Bot Parent must manually correct the FAQ and Dialog until the bot response results are as expected.

In the upper right corner, click the 'Evaluate Bot' button. Then, you will see an evaluate bot page, in the upper right corner click the ‘+New Script’ button.

You will see a pop-up to create a new script. Fill in the fields and after you’re done, you can click the 'Save' button to add a new script.

Select evaluation script that has been created, click the '+Script' button on the bottom, and enter a script in the User Say field that will be tested.

Select Bot and click the 'Play' button (). Wait for the test evaluation to succeed 100%. The results of the response bot will be the basis for subsequent validation, if the results of the bot response are still not appropriate, then it needs to be adjusted in the FAQ or Dialog that is tested.

Component Explanation:

Name	Description
M (Mark)	To mark the selected script.
User Say	This is the script being evaluated.
Intent Type	You may select the type of intent from the script entered, either Domain (FAQ) or Dialog.
Expected Intent	You can choose any knowledge title or dialog name. Note: This field will be adjusted according to your choice of intent type.
Bot Response	Response given by the bot based on the script entered.
Valid/Invalid	The red colour indicates that the expected intent with the intent name (result) does not match when the user validates the script. Whereas, the green colour indicates that the expected intent matches the intent name (result).
Evaluation Result	It displays the results of the evaluation of the script. There are three types of evaluation results: TP (True Positive): Indicates the intent name (result) based on the expected intent. FP (False Positive): Indicates the intent name (result) doesn't quite match the expected intent but the confidence level of the bot's response is high. FN (False Negative): Indicates the intent name (result) does not match the expected intent.
Score	Displays the confidence level of the bot's responses.
Intent Name (Result)	Displays the result of knowledge title or dialog name for the bot's response.
Intent Type (Result)	Indicates result type of intent from the script entered either Domain (FAQ) or Dialog.
Bot Id	Displays the selected bot's id.
Bot Name	Displays the selected bot's name.
Root Cause	Shows detailed information about the evaluation results issued.

Name

Description

M (Mark)

To mark the selected script.

User Say

This is the script being evaluated.

Intent Type

You may select the type of intent from the script entered, either Domain (FAQ) or Dialog.

Expected Intent

You can choose any knowledge title or dialog name. Note: This field will be adjusted according to your choice of intent type.

Bot Response

Response given by the bot based on the script entered.

Valid/Invalid

The red colour indicates that the expected intent with the intent name (result) does not match when the user validates the script. Whereas, the green colour indicates that the expected intent matches the intent name (result).

Evaluation Result

It displays the results of the evaluation of the script. There are three types of evaluation results:

TP (True Positive): Indicates the intent name (result) based on the expected intent.
FP (False Positive): Indicates the intent name (result) doesn't quite match the expected intent but the confidence level of the bot's response is high.
FN (False Negative): Indicates the intent name (result) does not match the expected intent.

Score

Displays the confidence level of the bot's responses.

Intent Name (Result)

Displays the result of knowledge title or dialog name for the bot's response.

Intent Type (Result)

Indicates result type of intent from the script entered either Domain (FAQ) or Dialog.

Bot Id

Displays the selected bot's id.

Bot Name

Displays the selected bot's name.

Root Cause

Shows detailed information about the evaluation results issued.