TestDino Changelog

Welcome to the TestDino Changelog! Here you'll find the latest release updates, new features, enhancements, and critical bug fixes—delivered regularly to help you get the most out of our AI-powered test automation platform.

We value your input. If you have suggestions, feature requests, or want to report an issue, reach out to us at support@testdino.com or connect with our community on Discord (opens in a new tab).

Nov 17, 2025 · v1.0.4

Performance optimization, enhanced collaboration, and improved debugging tools.

Added

• Analytics Updates:

  • Automated detection of slow-running tests with actionable recommendations.
  • Updated flakiness and test issues with clearer metrics and counts.
  • Summary tab now includes lists for flaky tests and new failures, plus grouped test retry trends.
  • Test Execution Performance Chart with five dynamic bands, plus a Poor/Critical test list for quick optimization targets.
  • New Test Cases chart and a New Test Case List showing all added cases for the selected period.

• Test Case History Tracking:

  • Record every test case execution within a branch.
  • Display summary metrics: total runs, pass/fail rates, flaky test detection, and stability percentage.
  • Recent activity section with run timestamps and status labels.
  • Execution history table with timestamp, run ID, status, duration, retries, and CI run location..

Improved

• Reduced dashboard load times by up to 60% through optimized queries.
• Enhanced AI suggestions with more context-aware recommendations.
• Better mobile responsiveness across all pages.
• Streamlined navigation with improved breadcrumbs and search.

Fixed

• Resolved intermittent issues with large file uploads.
• Fixed timezone display inconsistencies in reports.
• Corrected sorting issues in test case lists.

Nov 1, 2025 · v1.0.3

Test Case Management general availability and debugging improvements.

Added

• Test case management GA:
  • Polished list and suite views with:
    • Fast filtering and search.
    • Bulk actions for edit, move, tag, and delete.
    • Drag and drop to reorder suites and subsuites.
  • Stable CSV import and export flows with validation and duplicate handling.
  • Better inline editing for fields such as priority, severity, status, and type.

• Test Case Details:

  • Open test cases from analytics, test runs, or lists to see full context and past performance.
  • Choose a failed/passed/flaky test, then:
    • Open the related test case.
    • See historical performance for that case.
    • Specs Explorer is available separately to browse spec files and jump to related runs.

• Debug experience:

  • Consolidated evidence shows:
    • AI insight, error, stack trace, and history in one screen.
    • Screenshots, video, traces, and console logs grouped by attempt.
    • Clear flakiness indicators in both runs and test cases.

• PR and UI refinements:

  • Cleaner PR timeline and files view with clearer grouping by commit and run.
  • Better mobile layouts for key dashboards and details pages.

Improved

• Integration reliability for GitHub, Slack, and issue trackers.
• Login and session flow to reduce unexpected logouts and UI disruptions.
• Many small UX fixes across filters, tooltips, and navigation.

Sep 20, 2025 · v1.0.2

Integrations, external access, and platform scale.

Added

• Deeper integrations:
  • Bi-directional sync for Jira, Linear, and Asana:
    • Create issues from failing tests.
    • Sync status back into TestDino to reflect progress.
  • Email notifications for important events like new failures on main branches.
  • Improved Slack routing to route notifications by branch, environment, or project.

• Collaboration and external access:

  • Time-limited external access for vendors, clients, or auditors between 1 and 365 days.
  • Clear labelling for external users in UI.

• Organization and usage overview:

  • Usage tracking for runs and tests storage aligned with subscription plans.

• Data retention and storage:

  • Automated cleanup for old runs based on plan and project settings.

Improved

• Overall performance on accounts with extensive histories.
• Error handling for CI uploads, with clearer messages when payloads are invalid.
• UI polish on tables, filters, and charts.

Jul 22, 2025 · v1.0.1

Deeper analytics, smarter reruns, and a more powerful AI engine.

Added

• Advanced analytics:

  • Historical trend charts for pass rate, duration, and flakiness.
  • Cross-environment insights to spot issues that only appear in staging, QA, or production.

• Smart rerun detection and grouping:

  • Automatically group reruns by branch and commit.
  • Show parent-child relationships between the original run and all attempts.
  • View full attempt history for a test to understand how often it fails.

• Hybrid AI engine:

  • Combined ML classification with multiple LLMs.
  • Uses CI metadata, Git data, and past runs to improve root cause suggestions.
  • More accurate detection of unstable and environment-specific issues.

• Enhanced security and RBAC:

  • Comprehensive role-based access control with organization and project-level roles.
  • Organization roles: Owner, Admin, Member, Viewer.
  • Project roles: Admin, Editor, Viewer.
  • Fine-grained control over who can manage integrations, API keys, and project settings.

Improved

• Faster loading of analytics pages with server-side aggregation.
• Smoother navigation between projects and organizations.
• Clearer AI explanations in cases where multiple root causes are possible.

May 15, 2025 · v1.0.0 · Public Launch

Public launch with full PR workflows, subscriptions, and stronger CI behavior.

Added

• Subscription and plans:

  • Community, Pro, Team, and Enterprise tiers.
  • Usage limits by plan, including data retention and user limits.
  • Usage indicators so teams see how much of their plan they are using.

• Pull request workflows:

  • PR list view with:
    • Latest test runs and status badges.
    • Counts of passed, failed, skipped, and flaky tests.
  • PR overview tab with:
    • Key metrics such as pass rate, number of runs, average duration, and files changed.
    • AI-driven Insights that summarize impact and risk.
  • Timeline view with commits, test runs, and comments in order.
  • Files changed view linked to GitHub code review.

• AI in GitHub:

  • AI comments on pull requests and commits based on the environment.
  • Natural language explanation of what failed and why.
  • Suggestions on where to look in code or configuration.

• CI and rerun workflows:

  • Rerun only failed tests from TestDino through CLI.
  • Use cached context across shards and runners to keep reruns fast and cheap.
  • Support for multiple CI systems such as GitHub Actions, GitLab, CircleCI, Azure, and Jenkins.

• Integrations and attachments:

  • Asana integration to create issues for flaky or failed tests.
  • Stronger Jira and Linear integration paths.
  • Attachment management backed by secure Azure Blob Storage and CDN delivery.

• Dashboards for different roles:

  • QA focused view with failures, blockers, and coverage gaps.
  • Developer-focused view with recent PRs, failing tests, and AI suggestions.

Improved

• Performance and stability in large organizations with many projects.
• Authentication flow and session handling for long-lived browser sessions.

Mar 31, 2025 · v0.3.0-beta

Test Case Management and deeper collaboration features.

Added

• Test case management (beta):

  • Manage manual and automated test cases in one place.
  • Support for:
    • Title, description, preconditions, postconditions.
    • Structured steps and expected results or free text.
    • Custom fields for classification and metadata.
  • Nested suites and subsuites to mirror your application structure.
  • Clone, bulk edit, and bulk delete actions.

• Test case import and history:

  • Import and export cases via CSV with mapping.
  • Track history and metrics for each test case:
    • Past runs, pass rate, and stability over time.
    • Linked automated runs from CI.

• Specs explorer:

  • Browse specs from file structure to locate failing tests quickly.
  • Jump from a spec to recent runs and AI insights.

• Evidence rich views:

  • Enhanced run details with:
    • Screenshots, videos, traces, and console logs in a unified view.
    • Visual comparison for image mismatch issues.
    • Better search and filters inside a run.

• Team management and multi-project:

  • Stronger organizational view with multiple projects.
  • Per project settings for integrations and CI configuration.
  • Enhanced role-based access control at the organization and project levels.
  • Early version of time-bound external access for guest users.

Improved

• More stable Slack and Jira integrations during heavy test runs.
• Clearer empty states in dashboards and test case pages.

Feb 28, 2025 · v0.2.0-beta

Smarter AI, better analytics, and first CI optimization features.

Added

• AI-driven insights:

  • Full AI and ML pipeline for understanding failures.
  • Adaptive failure classification that learns from your project history.
  • Detailed error categorization across 13 categories, including:
    • Assertion failures
    • Element not found
    • Timeout and timing issues
    • Network issues
    • Environment-dependent problems
    • Intermittent and flaky assertions
    • Manually skipped or configuration skipped tests
  • Natural language root cause summaries and suggested fixes, using multiple LLMs and project context.

• Advanced analytics foundation:

  • Project-level analytics for:
    • Pass rate over time.
    • Execution time trends.
    • Failure patterns across branches and environments.
  • Flaky test detection based on historical runs and categories.
  • Lists of slowest and most unstable tests.

• Branch and environment mapping:

  • Map branches to environments using exact match or regex rules.
  • Validation and guardrails to avoid invalid mappings.
  • Use these mappings in dashboards, filters, and notifications.

• CI optimization (first step):

  • Run cache for "Last failed tests" so you can rerun only failed tests from the previous run.
  • Support for multiple CI providers through documented CLI commands.

• Integrations:

  • Slack app with OAuth-based onboarding.
  • Notifications based on branch and environment mappings.
  • Early Jira and Linear integration support to create issues from failed tests.

• Data retention settings:

  • Per plan defaults for how long to keep test data.
  • Basic cleanup rules for older runs.

Improved

• Faster loading of analytics pages for larger projects.
• More consistent error messages when uploads fail or contain invalid data.

Jan 20, 2025 · v0.1.0-beta

First private beta of TestDino.

• Core platform:

  • Organizations and projects with basic member management.
  • API keys to connect CI pipelines and upload test runs.
  • Initial dashboard to see recent runs, pass rate, and execution time.

• Test run ingestion and views:

  • Upload automated test results from CI.
  • Test Run details page with:
    • Test list and status.
    • Error messages and basic console logs.
    • Screenshots and videos.

• Early AI insights:

  • First version of AI error understanding.
  • Groups failures into simple categories such as assertion failures, element not found, timeout, and other errors.
  • Short natural language explanation of the failure, based on error message and logs.

• Authentication and access:

  • Email and password login with JWT-based authentication.
  • Basic role-based access inside an organization (admin and member).
  • Invite flow for adding teammates to projects.

• GitHub and CI groundwork:

  • Connect GitHub repositories to projects.
  • Link test runs to branches and commits.
  • Initial CI integration so you can send runs from your existing pipelines.