The Flow Health dashboard summarizes how well the flows of your app are performing and shows the coverage of intents and transitions in the app definition. It displays the overall pass or fail percentage of test cases with options to view transition coverage and intent summaries.
Use the test result analysis to identify issues in dialog task definitions and fix them with actionable recommendations to improve overall flow health.
Go to: Testing > Regression Testing > Health & Monitoring > Flow tab
Flow Metrics
The Flow Health dashboard aggregates all test suite results from Conversation Testing and presents the following metrics:
| Metric | Description |
|---|
| Pass | Total number of test cases passed across all test suites. |
| Fail | Total number of test cases failed across all test suites. |
| Not Executed | Total number of test cases aborted or not executed across all test suites. |
View Test Suites
Click View Test Suites to see all test suites considered for the app:
| Column | Description |
|---|
| Test Suite | Name of the test suite. |
| Result | Result of the test suite: Passed, Failed, Aborted, or Not Executed. |
| Duration | Time taken to execute the test suite. |
| Test Cases | Total number of test cases in the suite. |
| Pass | Number of test cases that passed. |
| Fail | Number of test cases that failed. |
| Not Executed | Number of test cases not executed. |
| Pass % | Overall pass percentage of the test cases. |
The Flow Health dashboard considers standard responses in test cases when calculating overall percentages, but has no separate summary tile for Standard Responses. This may cause slight differences in overall counts or percentages.
Dialog Intent Summary
The Dialog Intent Summary shows test results analysis for dialog intents from Conversation Testing, including insights into flow transitions that are covered and missed.
All test cases across test suites that expect a dialog node for assertion are considered when generating the flow summary.
Transitions Coverage
The Transitions Coverage section shows how many transitions in your app definition are covered by test cases.
| Metric | Description |
|---|
| Total Transitions Covered | All covered transitions out of total transitions in the app definition. |
| Covered | Number of transitions covered in test cases. |
| Not Covered | Percentage of transitions not covered in test cases. |
| Column | Description |
|---|
| Task Name | Name of the dialog intent. |
| From Node | Starting node of the transition. |
| To Node | Destination node of the transition. |
| Status | Whether the transition is covered or not covered. |
Conversation Test Results Analysis
The Conversation Test Results Analysis section summarizes all test suite results:
| Metric | Description |
|---|
| Total Test Cases | Total number of test cases in the test suite. |
| Pass | Count and percentage of test cases that passed. |
| Fail | Count and percentage of test cases that failed. |
| Not Executed | Count and percentage of test cases not executed. |
View Intent Summary
Click View Intent Summary to open the Dialog Intent Details view, which shows all intents covered in a test suite with:
- Total transitions covered and missed.
- Percentage of test cases with Pass, Fail, or Not Executed status per intent.
Click Covered By for any intent to see which test suites cover it and the breakdown of transitions and test case results.
Click the > icon on any intent to open its intent details summary, then click a Test Suite Name to view that suite’s test results analysis. A test case failure typically indicates a mismatch between expected and actual output. See Test Case Assertion.
FAQ Summary
The FAQ Summary section displays FAQ coverage and Conversation Test Results Analysis for all FAQ intents across the selected test suite.
Click View Intent Summary to open the FAQ Intent Details window:
| Column | Description |
|---|
| Intent Name | Name of the FAQ intent. |
| Path | Node path in the Knowledge Graph. |
| Covered by (Test Suites) | Number of test suites covering the FAQ intent. |
| Total Test Cases | Number of test cases for that FAQ intent. |
| Pass | Number of FAQ test cases that passed. |
| Fail | Number of FAQ test cases that failed. |
| Not Executed | Number of FAQ test cases not executed. |
| Pass % | Overall pass percentage. |
Small Talk Summary
The Small Talk Summary section displays Small Talk coverage and Conversation Test Results Analysis for all Small Talk intents in the selected test suite.
Click View Intent Summary to open the Small Talk Details window:
| Column | Description |
|---|
| Intent Name | Intent name from the Small Talk interaction. |
| Group | Group to which the Small Talk interaction is mapped. |
| Covered by (Test Suites) | Number of test suites covering the Small Talk intent. |
| Total Test Cases | Number of test cases for that Small Talk intent. |
| Pass | Number of Small Talk test cases that passed. |
| Fail | Number of Small Talk test cases that failed. |
| Not Executed | Number of Small Talk test cases not executed. |
| Pass % | Overall pass percentage. |
