Create Validation Script
The Validation Script is used as a Bot Parent reference to check the desired Bot response results. If the bot response results are still not appropriate, then the Bot Parent must manually correct the FAQ and Dialog until the bot response results are as expected.
In the upper right corner, click the 'Evaluate Bot' button. Then, you will see an evaluate bot page, in the upper right corner click the ‘+New Script’ button.
You will see a pop-up to create a new script. Fill in the fields and after you’re done, you can click the 'Save' button to add a new script.
Select evaluation script that has been created, click the '+Script' button on the bottom, and enter a script in the User Say field that will be tested.
Select Bot and click the 'Play' button (
). Wait for the test evaluation to succeed 100%. The results of the response bot will be the basis for subsequent validation, if the results of the bot response are still not appropriate, then it needs to be adjusted in the FAQ or Dialog that is tested.
Component Explanation:
M (Mark)
To mark the selected script.
User Say
This is the script being evaluated.
Intent Type
You may select the type of intent from the script entered, either Domain (FAQ) or Dialog.
Expected Intent
You can choose any knowledge title or dialog name. Note: This field will be adjusted according to your choice of intent type.
Bot Response
Response given by the bot based on the script entered.
Valid/Invalid
The red colour indicates that the expected intent with the intent name (result) does not match when the user validates the script. Whereas, the green colour indicates that the expected intent matches the intent name (result).
Evaluation Result
It displays the results of the evaluation of the script. There are three types of evaluation results:
TP (True Positive): Indicates the intent name (result) based on the expected intent.
FP (False Positive): Indicates the intent name (result) doesn't quite match the expected intent but the confidence level of the bot's response is high.
FN (False Negative): Indicates the intent name (result) does not match the expected intent.
Score
Displays the confidence level of the bot's responses.
Intent Name (Result)
Displays the result of knowledge title or dialog name for the bot's response.
Intent Type (Result)
Indicates result type of intent from the script entered either Domain (FAQ) or Dialog.
Bot Id
Displays the selected bot's id.
Bot Name
Displays the selected bot's name.
Root Cause
Shows detailed information about the evaluation results issued.
Last updated
Was this helpful?