Skip to main content
What you’ll learn
  • How to search, filter, and sort test runs
  • What each run column and tag type means
  • How run grouping and sharded runs work
  • What each detail tab (Summary, Specs, Errors, Anomalies, Configuration, Coverage, AI Insights) provides
The Test Runs page lists every Playwright test execution in your project. Identify failing or flaky runs, confirm where they happened (branch and environment), and open detailed evidence for debugging.

Search and Filters

Tags Filter

The Tags dropdown contains 2 tabs: Type in the search box to find a specific tag. Select one or more tags to filter the list. Multiple tags use OR logic: a run matches if it contains any of the selected tags.

Active Test Runs

Runs currently executing appear in a collapsible Active Test Runs section at the top of the list. Results update in real time as tests complete. Each active run displays a progress bar, live pass/fail/skip counts, commit, branch, and CI source. Active test run with sharded execution showing shard tabs, worker status, and live progress bar For sharded runs, the run is labeled SHARDED with tabs for each shard. Select a shard tab to view its workers and currently executing tests. Non-sharded runs show a single progress bar with per-worker detail.

Run Columns

Test runs list showing run ID, commit info, branch, environment, and test results counts

Run Grouping

Runs that share the same commit hash and commit message are grouped as attempts by TestDino. This usually happens when you rerun a CI workflow or trigger multiple executions for the same commit. Expand the group to see each attempt (for example, Attempt #1, Attempt #2). This grouping helps you:
  • Track reruns for a single commit without scanning separate rows
  • Compare results across attempts to confirm if a rerun fixed flaky failures
  • See how many times a workflow was triggered for the same code change

Run-Level Tags

Attach labels to an entire test run using the --tags CLI flag. Tags appear as chips on each run row in the list and are available as filter values.
Use run-level tags to label runs by build number, sprint, release, or test type. These are separate from test-case-level tags set via annotations.

Run Detail Header

Opening a test run displays a header bar above the detail tabs. The header contains: Tags in the header are the same run-level tags set via the --tags CLI flag. They are visible across all detail tabs.

Shards Breakdown

Runs split with Playwright’s --shard show a Shards section at the top of the Summary tab. It breaks results down by shard, so you can see how each slice performed and whether the work was split evenly. The section appears only for sharded runs. Non-sharded runs do not show it. TestDino merges the shard slices into 1 run when you pass the same --ci-run-id to every shard. Learn how to group shards in the Node.js CLI guide. Each row is 1 shard. The header adds a couple of signals once the run finishes:
  • Imbalance, such as 3.0×, shows how much longer the slowest shard ran than the fastest. Closer to means the work was split evenly; higher means 1 shard lagged.
  • A failure concentration note appears when 1 shard holds most of the run’s failures.
If some shards never report, the section flags which ones are missing and marks the run incomplete. Scope the analysis to a shard: click a shard row to filter the Detailed Analysis list below to only that shard’s tests. Select several rows to combine them. Each test case in the list also carries a colored Shard N tag so you can trace which shard ran it.

Get Started

  1. Set scope - Filter by Time Period, Environment, Branch, Committer, Status, or Tags, and sort by Duration to focus the list.
  2. Scan and open - Review result counts, then open a run that needs action.
  3. Review details - The run details page provides these tabs:
    • Summary: Totals for Failed, Flaky, and Skipped with sub-causes and test case analysis
    • Specs: Results grouped by spec file. Find failing or slow files, then open the tests within a spec.
    • Errors: Groups failed and flaky tests by error message. Jump to stack traces.
    • Anomalies: What changed versus the recent baseline. New failures, slowdowns, new flakes, and recoveries.
    • Configuration: Source, CI, system, and test settings. Detect config drift.
    • Coverage: Statement, branch, function, and line coverage with per-file breakdown.

Summary

Group failures and flakiness by cause

Detailed Analysis

Drill down to specific tests

Specs

Review results by spec file

Errors View

Group failures by error message

Anomalies

See what changed versus the recent baseline

Analytics

Track reliability and duration trends over runs

Configuration Context

Debug environment differences

Coverage

Per-run code coverage breakdown

Test Case Details

Individual test analysis

Playwright Test Run Failure Summary

Review failed, flaky, and skipped tests grouped by cause.

Playwright Test Run Error Grouping

Group failed and flaky tests by error message within a run.

Playwright Test Run Spec File View

View test run results grouped by spec file.

Playwright Test Run Anomalies in TestDino

See what changed in a Playwright test run compared to the project's recent baseline: new failures, slowdowns, new flakes, and recoveries.

Playwright Test Run Code Coverage View

View per-run code coverage metrics and file-level breakdowns.

Playwright Test Run Configuration View

View source control, CI, system, and Playwright config for a test run.