Skip to content

Latest commit

 

History

History

flaky-tests

description
Detect, quarantine, and eliminates flaky tests from your codebase

Flaky Tests (beta)

Trunk Flaky Tests lets your teams detect, track, quarantine, and fix flaky tests in your codebase. Flaky Tests is language, environment, and framework-agnostic.

Let's explore how Trunk Flaky Tests' features help you tackle Flaky Tests. If you can't wait to try Trunk, follow our getting started guide.

You can see a tour of Trunk Flaky Tests in this video.

{% embed url="https://youtu.be/F2lyu9s-rxs" %}

Understand The Impact

Your dashboard shows a comprehensive overview of your test suite's health at a glance. It lets you see important impact metrics like the number of flaky tests, broken tests, PRs impacted by flaky tests, and PRs rescued by quarantining flaky tests.

Key repo metrics

To learn more, see how Flaky Tests does detection.

Track Every Flaky Test

You can find a list of known flaky tests complete with important information like their impact on PRs and if someone's working on a fix. For more granularity, you can also inspect individual tests for their execution history, results, and status changes.

List of flaky tests

To learn more, see how Flaky Tests does detection.

Stay in Sync

PR comment linking to PR Test Summary

PR comment linking to PR Test Summary

Flaky Tests helps everyone in your team stay in sync about flaky test failures with GitHub PR comments, so no time is wasted debugging failures from known flaky tests.

To learn more, see our docs about GitHub Comments and Test Summaries.

Investigate Flaky Failures

Flaky Tests creates detailed reports for individual test failures so you can debug faster.

Summary of unique failure types

Test details will summarize all the unique ways a flaky test fails and let you flip through the relevant stack traces in the Trunk app.

Full failure stack traces

To learn more, see our docs about the detection of flaky tests.

Quarantine Flaky Failures

Flaky Tests allows you to quarantine detected flaky tests, stopping them from failing your CI jobs. This prevents failed flaky tests from impacting your CI pipelines, so you won’t have to disable tests and won’t be slowed down by flaky CI jobs.

flaky tests can be quarantined automatically or manually

To learn more, see our docs about quarantining tests.

Manage Tickets

Creating a Jira ticket for a flaky test

Trunk enables the automation of quickly creating and assigning tickets through integrations with platforms like Jira and Linear, as well as custom workflows with webhooks. The status of tickets created will be reflected in real-time in the Trunk web app. This helps you track efforts to fix high-impact, flaky tests.

To learn more, learn about our ticketing integrations.

Next Steps

Getting Started

get-started

Join Trunk

https://app.trunk.io/signup?intent=flaky%20tests

Start finding flaky tests today by signing up for Trunk or reading our Getting Started guides.