Playwright Test Run AI Insights

The AI Insights tab analyzes a test run and summarizes failures. It groups similar errors and assigns a category to each failure.

​

KPI Tiles

​

Error Variants

Shows distinct error signatures and how many tests match each variant, for example, timeout, element not found, network error, or timing-related. Use this to identify the most common failure shape in the run.

​

AI Failure Categorization

Shows how failures are classified into:

• Actual bug
• UI change
• Unstable Test
• Miscellaneous

Each label includes a confidence score. Use this to separate likely product issues from unstable tests.

​

Error Analysis

This table lists failing tests with:

• Test case
• Failure category
• Error text
• Error variant
• Duration

Use the duration filter to scope by runtime, for example, fast or medium, when investigating clusters.

​

Filtering

Selecting any tile (variant or category) adds an active filter chip and scopes the table to matching tests. Combine one Error Variant with one AI Category to get a focused slice, for example, Actual Bug + Timeout.

​

Related