QA Dashboard

The QA Dashboard is designed to give Quality Assurance teams a comprehensive view of the project's test health. This includes critical metrics and AI-driven insights that can help identify issues faster.

Why This is Beneficial

Testdino understands that for QA engineers, efficiency is key. Testdino doesn’t just show test results; it highlights where the most critical issues lie and provides a quick path to resolving them.

With AI-powered failure categorization and flakiness tracking, QA teams can differentiate between real product bugs and test instability, reducing the time spent on false alarms.

Select filters like Environment and Period to get a better view of your testing performance over time.

Key Metrics

key metrics

1. Total Test Case Execution

Displays the number of tests executed during the selected period. This will give you a quick understanding of the volume of testing done.

2. Total Passed Test Cases

The total count of tests that passed helps track test stability and reliability.

3. Total Failed Test Cases

Displays how many tests failed. This gives an immediate insight into areas that need attention.

4. Average Time Duration

The average duration of test executions allows QA to assess testing efficiency.

5. Most Flaky Tests

Identifies the tests that fail intermittently, highlighting tests that need further investigation to identify whether failures are due to issues in the code or unreliable test scripts.

6. Test Failure Categories

Breaks down failure categories like Flaky Tests, UI Changes, Actual Bugs, and Miscellaneous. And provides a deeper understanding of the nature of failures, helping QA teams prioritize their actions.

  • Flaky Tests: Intermittent failures from timing, race, order, shared state, or network. Often passes on retry or only fails in CI.

  • UI Changes: DOM or selector changes break interactions. You’ll see “locator not found,” timeouts, or text mismatches after UI updates.

  • Actual Bugs: Real product defects. Assertions fail consistently across runs or environments and need a code fix.

  • Miscellaneous: Non-product issues like setup or script errors, env misconfig, missing data/credentials, CI problems, or external service downtime.

AI Insights

ai insight

1. Critical Issues

AI identifies major issues affecting test stability. Helps QA teams focus on the most important issues first.

2. Trend Analysis

AI tracks and predicts trends in test results. Allows QA teams to understand test stability over time.

3. Optimization Opportunities

AI suggests improvements for test execution and stability. Provides actionable insights for improving testing efficiency.

Cross-Environment Performance

cross environments

QA teams can compare the performance of tests across various environments (like Prod, Stage, QA, Dev, etc.) to ensure consistency.

1. Pass Rate

Shows the pass rate of tests across different environments.
Why it matters: Helps identify if certain environments are causing failures.

2. Total Test Executions

Displays the number of tests run per environment. Provides a deeper view into how tests perform in different environments.

3. Flaky Rate

Measures the flaky tests in each environment. Allows you to focus on unreliable tests in specific environments.

4. Average Execution Time

Shows the average execution time for tests in different environments. A crucial metric for optimizing testing time.

When reviewing test failures, use the Test Failure Categories to quickly understand whether the issue is related to flaky tests or actual bugs.