Python CLI for Playwright - TestDino Documentation

What you’ll learn

Three commands: upload, cache, and last-failed
Upload options for HTML, images, videos, traces, and full bundles
How to cache metadata and rerun only failed tests

testdino is the TestDino Python CLI for Playwright. It uploads pytest-based Playwright reports, caches test metadata, and retrieves failed tests for selective reruns.

Prerequisites

Python >= 3.9
pytest with pytest-playwright
pytest-playwright-json (generates the required JSON report)
pytest-html (generates HTML report)
TestDino API token (generate one)
Git initialized repository (for commit and branch metadata)
pytest configured with JSON and HTML reporter flags:

pytest \
  --playwright-json=test-results/report.json \
  --html=test-results/index.html \
  --self-contained-html

Installation

pip install pytest-playwright-json pytest-html testdino

Quick Start

Run tests with JSON output

pytest \
  --playwright-json=test-results/report.json \
  --html=test-results/index.html \
  --self-contained-html

Upload the report

testdino upload ./test-results --token="$TESTDINO_TOKEN"

Cache metadata for reruns

testdino cache --working-dir test-results --token="$TESTDINO_TOKEN"

The upload command requires a JSON report. Always run pytest with the --playwright-json flag.

Commands

`upload`

Upload Playwright test reports and artifacts to TestDino.

testdino upload <report-directory> --token="$TESTDINO_TOKEN"

Upload flags:

Flag	Description
`--upload-images`	Upload screenshots
`--upload-videos`	Upload video recordings
`--upload-html`	Upload HTML reports
`--upload-traces`	Upload trace files
`--upload-files`	Upload file attachments (`.md`, `.pdf`, `.txt`, `.log`)
`--upload-full-json`	Upload all attachments

# Upload with all artifacts
testdino upload ./test-results --token="$TESTDINO_TOKEN" --upload-full-json

# Upload with specific artifacts
testdino upload ./test-results --token="$TESTDINO_TOKEN" --upload-images --upload-videos

# Upload with environment tag
testdino upload ./test-results --token="$TESTDINO_TOKEN" --environment="staging"

`cache`

Store test execution metadata after a run. Powers the last-failed command.

testdino cache --working-dir test-results --token="$TESTDINO_TOKEN"

Option	Description	Default
`--working-dir <path>`	Directory containing test results	Current directory
`--cache-id <value>`	Custom cache ID override	Auto-detected

`last-failed`

Retrieve cached test failures for reruns. Outputs test identifiers that pass directly to pytest.

# Print failed tests
testdino last-failed --token="$TESTDINO_TOKEN"

# Rerun only failed tests
pytest $(testdino last-failed --token="$TESTDINO_TOKEN")

# Failed tests for a specific shard
testdino last-failed --shard="2/5" --token="$TESTDINO_TOKEN"

Option	Description	Default
`--branch <value>`	Branch name override	Auto-detected
`--commit <value>`	Commit hash override	Auto-detected
`--shard <value>`	Shard specification (e.g., `2/5`)	None
`--environment <value>`	Environment name for filtering	None
`--cache-id <value>`	Custom cache ID override	Auto-detected

Global Options

These options apply to all commands.

Option	Description
`-t, --token <value>`	TestDino API token (required)
`-v, --verbose`	Enable verbose logging

Configuration

Set environment variables to avoid passing flags with each command.

Variable	Description
`TESTDINO_TOKEN`	Authentication token
`TESTDINO_TARGET_ENV`	Default environment tag

export TESTDINO_TOKEN="your-api-token"
export TESTDINO_TARGET_ENV="staging"

CI/CD Integration

GitHub Actions
GitHub Actions (Sharded)
GitLab CI
Jenkins

.github/workflows/test.yml

name: Playwright Tests
on: [push, pull_request]

jobs:
  test:
    runs-on: ubuntu-latest
    steps:
      - uses: actions/checkout@v4
        with:
          fetch-depth: 0
      - uses: actions/setup-python@v5
        with:
          python-version: '3.11'

      - name: Install dependencies
        run: |
          pip install pytest pytest-playwright pytest-playwright-json pytest-html testdino
          playwright install chromium --with-deps

      - name: Run tests
        run: |
          pytest \
            --playwright-json=test-results/report.json \
            --html=test-results/index.html \
            --self-contained-html

      - name: Cache metadata
        if: always()
        run: testdino cache --working-dir test-results --token="${{ secrets.TESTDINO_TOKEN }}"

      - name: Upload reports
        if: always()
        env:
          TESTDINO_TOKEN: ${{ secrets.TESTDINO_TOKEN }}
        run: testdino upload ./test-results --token="${{ secrets.TESTDINO_TOKEN }}" --upload-full-json

.github/workflows/test-sharded.yml

name: Playwright Tests (Sharded)
on: [push, pull_request]

jobs:
  test:
    runs-on: ubuntu-latest
    strategy:
      fail-fast: false
      matrix:
        shardIndex: [1, 2, 3, 4]
        shardTotal: [4]
    steps:
      - uses: actions/checkout@v4
        with:
          fetch-depth: 0
      - uses: actions/setup-python@v5
        with:
          python-version: '3.11'

      - name: Install dependencies
        run: |
          pip install pytest pytest-playwright pytest-playwright-json pytest-html testdino
          playwright install chromium --with-deps

      - name: Run tests
        shell: bash
        env:
          TESTDINO_TOKEN: ${{ secrets.TESTDINO_TOKEN }}
        run: |
          mkdir -p test-results

          if [[ "${{ github.run_attempt }}" -gt 1 ]]; then
            testdino last-failed \
              --shard=${{ matrix.shardIndex }}/${{ matrix.shardTotal }} \
              --token="$TESTDINO_TOKEN" > last-failed-flags.txt
            FAILED_TESTS="$(cat last-failed-flags.txt | tail -1)"

            if [[ -z "$FAILED_TESTS" ]]; then
              echo "No failed tests found. Exiting."
              exit 0
            fi

            eval "pytest $FAILED_TESTS \
              --playwright-json=test-results/report.json \
              --html=test-results/index.html \
              --self-contained-html -v" || true
            exit 0
          fi

          pytest \
            --playwright-json=test-results/report.json \
            --html=test-results/index.html \
            --self-contained-html -v || true

      - name: Cache metadata
        if: always()
        run: testdino cache --working-dir test-results --token="${{ secrets.TESTDINO_TOKEN }}"

      - name: Upload reports
        if: always()
        run: testdino upload ./test-results --token="${{ secrets.TESTDINO_TOKEN }}" --upload-full-json

.gitlab-ci.yml

image: python:3.11

stages:
  - test

playwright-tests:
  stage: test
  script:
    - pip install pytest pytest-playwright pytest-playwright-json pytest-html testdino
    - playwright install chromium --with-deps
    - pytest --playwright-json=test-results/report.json --html=test-results/index.html --self-contained-html
    - testdino upload ./test-results --token="$TESTDINO_TOKEN" --upload-full-json
  when: always

Jenkinsfile

pipeline {
    agent any

    environment {
        TESTDINO_TOKEN = credentials('testdino-token')
    }

    stages {
        stage('Test') {
            steps {
                sh 'pip install pytest pytest-playwright pytest-playwright-json pytest-html testdino'
                sh 'playwright install chromium --with-deps'
                sh 'pytest --playwright-json=test-results/report.json --html=test-results/index.html --self-contained-html'
                sh 'testdino upload ./test-results --token="$TESTDINO_TOKEN" --upload-full-json'
            }
        }
    }
}

View Test Runs

Explore test results in the platform

CI Optimization

Optimize your CI pipeline

Node.js CLI

Use TestDino with Playwright for Node.js

Generate API Keys

Create and manage API tokens

​Prerequisites

​Installation

​Quick Start

​Commands

​upload

​cache

​last-failed

​Global Options

​Configuration

​CI/CD Integration

​Related

View Test Runs

CI Optimization

Node.js CLI

Generate API Keys

Prerequisites

Installation

Quick Start

Commands

`upload`

`cache`

`last-failed`

Global Options

Configuration

CI/CD Integration

Related