TestDino CircleCI Orb Setup - TestDino Documentation

What you’ll learn

How to upload Playwright results using the TestDino CircleCI Orb
Orb configuration options for HTML, full bundle, and custom paths

Set up CircleCI to upload Playwright test results to TestDino using the TestDino Orb — a prebuilt package that wraps the TestDino CLI so you don’t need to install it separately. This guide covers orb configuration options for HTML uploads, full bundles, and custom paths.

RecommendationFor more configuration options and the latest features, use the TestDino CLI approach instead. The Orb wraps the CLI but may not include all new updates immediately.

Prerequisites

Before setting up, ensure you have:

A TestDino account with a project created
A TestDino API key (Generate API Keys)
TestDino Example Repository for sample tests and ready-to-use CI configs
A CircleCI account with access to your repository
Playwright configured with JSON and HTML reporters in playwright.config.js:

playwright.config.js

// ...existing config

reporter: [
  ['html', { outputDir: './playwright-report' }],  // Optional
  ['json', { outputFile: './playwright-report/report.json' }],  // ✅ Required
]

Set Up Your API Key

Open your project in CircleCI
Go to Project Settings → Environment Variables
Click Add Environment Variable
Set the name to TESTDINO_TOKEN
Paste your TestDino API key as the value
Save the variable

WarningNever commit your API key directly in config files. Always use environment variables.

Basic Upload

.circleci/config.yml — Basic upload

.circleci/config.yml

version: '2.1'
orbs:
  testdino: testdino/testdino@1.0.0
jobs:
  run-tests:
    docker:
      - image: mcr.microsoft.com/playwright:v1.40.0-focal
    steps:
      - checkout
      - run:
          command: npm ci
          name: Install dependencies
      - run:
          command: npx playwright test
          name: Run Playwright tests
      - testdino/upload-report:
          report_directory: ./playwright-report
          token: TESTDINO_TOKEN
workflows:
  test-and-upload:
    jobs:
      - run-tests

Upload with HTML Report

.circleci/config.yml — Upload with HTML report

.circleci/config.yml

version: '2.1'
orbs:
  testdino: testdino/testdino@1.0.0
jobs:
  upload-with-html:
    docker:
      - image: mcr.microsoft.com/playwright:v1.40.0-focal
    steps:
      - checkout
      - run:
          command: npm ci
          name: Install dependencies
      - run:
          command: npx playwright test
          name: Run Playwright tests
      - testdino/upload-report:
          report_directory: ./playwright-report
          token: TESTDINO_TOKEN
          upload_html: true
          verbose: true
      - store_artifacts:
          destination: playwright-report
          path: ./playwright-report
workflows:
  test-with-testdino:
    jobs:
      - upload-with-html:
          context: testdino-credentials

Upload Full Bundle

Include all artifacts (JSON, images, videos) in one upload.

.circleci/config.yml — Upload full bundle

.circleci/config.yml

version: '2.1'
orbs:
  testdino: testdino/testdino@1.0.0
jobs:
  upload-full-bundle:
    docker:
      - image: mcr.microsoft.com/playwright:v1.40.0-focal
    steps:
      - checkout
      - run:
          command: npm ci
          name: Install dependencies
      - run:
          command: npx playwright test
          name: Run Playwright tests
      - testdino/upload-report:
          report_directory: ./playwright-report
          token: TESTDINO_TOKEN
          upload_full_json: true
          verbose: true
workflows:
  test-with-testdino:
    jobs:
      - upload-full-bundle:
          context: testdino-credentials

Upload with Custom Paths

Specify custom report paths and include images and videos.

.circleci/config.yml — Upload with custom paths

.circleci/config.yml

version: '2.1'
orbs:
  testdino: testdino/testdino@1.0.0
jobs:
  upload-with-custom-paths:
    docker:
      - image: mcr.microsoft.com/playwright:v1.40.0-focal
    steps:
      - checkout
      - run:
          command: npm ci
          name: Install dependencies
      - run:
          command: npx playwright test
          name: Run Playwright tests
      - testdino/upload-report:
          report_directory: ./test-results
          json_report: ./test-results/results.json
          html_report: ./test-results/index.html
          token: TESTDINO_TOKEN
          upload_images: true
          upload_videos: true
workflows:
  test-with-testdino:
    jobs:
      - upload-with-custom-paths:
          context: testdino-credentials

Orb Parameters

Parameter	Required	Description
`report_directory`	Yes	Path to the Playwright report directory
`token`	Yes	CircleCI environment variable name holding the TestDino API key
`upload_html`	No	Upload HTML report (`true` / `false`)
`upload_full_json`	No	Upload full JSON bundle with all artifacts
`upload_images`	No	Upload screenshot attachments
`upload_videos`	No	Upload video recordings
`json_report`	No	Custom path to JSON report file
`html_report`	No	Custom path to HTML report file
`verbose`	No	Enable verbose logging output

TipUse CircleCI contexts (e.g., testdino-credentials) to manage secrets across multiple jobs without repeating environment variable setup.

Troubleshooting

Orb not found or version error

Ensure the orb is imported correctly: testdino: testdino/testdino@1.0.0. Check the CircleCI Orb Registry for the latest version.

TESTDINO_TOKEN not found

Confirm the environment variable is set in CircleCI → Project Settings → Environment Variables. If using contexts, verify the job references the correct context name.

Next Steps

CI Optimization

Reduce CI time with smart reruns

Branch Mapping

Map branches to environments for organized test runs

Integrations

Connect Slack, Jira, Linear, Asana, and more

TestDino MCP

Access test results and fix issues with AI agents

​Prerequisites

​Set Up Your API Key

​Basic Upload

​Upload with HTML Report

​Upload Full Bundle

​Upload with Custom Paths

​Orb Parameters

​Troubleshooting

​Next Steps

CI Optimization

Branch Mapping

Integrations

TestDino MCP

Prerequisites

Set Up Your API Key

Basic Upload

Upload with HTML Report

Upload Full Bundle

Upload with Custom Paths

Orb Parameters

Troubleshooting

Next Steps