Analytics
Test Case

Test Case

A focused view to understand how individual tests behave: which ones are fast or slow, how they trend, and where to invest tuning time. Use the top controls (Time range, Environment, Branches) to maintain a consistent scope while reviewing.

Key Metrics

Overview

1. Average Test Cases

Shows the average number of test cases executed per run for the selected period. Use it to spot scope creep or missing coverage when the number shifts.

2. Fastest Test

Displays the shortest test duration with the test name, establishing a baseline for lightweight checks and smoke tests.

3. Slowest Test

Displays the longest single test duration, pointing to prime candidates for optimization or splitting to reduce cycle time.

4. Average Test Duration

Reports the mean time for one test case across the period. Track this metric to estimate total run time and verify performance improvements.

Slowest Test Cases

A table of optimization targets with columns for Test Name, Avg Duration, Frequency, Max Duration, and Performance Trend.

Slowest test cases list and metrics

You can identify the tests that consume the most time, how often they run, the worst-case time, and whether they are getting slower, faster, or remain stable.

Test Cases Pass/Fail History

Compare up to 10 tests side by side and see their changes over time. The view helps spot unstable tests, confirm fixes, and identify the day a regression started.

Test cases pass/fail history chart

Selected Test Cases

  • Shows the current comparison set.
  • Each item displays the test name and a color that matches the corresponding legend in the chart.
  • Remove an item to free a slot and update the chart immediately.

Available Tests

  • Provides a searchable list of all test cases you can add to the comparison.
  • Selecting a test moves it into Selected Test Cases until the 10-test limit is reached.
  • The list remains available, allowing you to swap tests in and out without leaving the view.

Pass/Fail Trends

  • Plots a line for each selected test across the chosen time range.
  • The y-axis represents the pass rate, ranging from 0% to 100%, and the x-axis indicates the calendar date.
  • Hover to see the details for each test, including pass and fail counts and the pass rate.
  • Use the legend to relate each line to its test name and track changes after code or test updates.

Test Execution Performance

The Bar chart shows how test cases are distributed into performance bands labeled Excellent, Good, Average, Poor, and Critical, based on their execution time.

Test execution performance metrics

Average Test Cases per Day

Line chart of new test cases added per day with the current-period average. Monitor test creation activity and coverage growth to balance quality work with build time. <add_image>

Test Case Status Heatmap

Matrix of tests by branch with a colored badge indicating the performance band achieved on that branch.

Compare execution speed across branches to spot branch-specific slowness or regressions that do not appear elsewhere.

Test case status heatmap visualization