Test Runners

Flakiness.io has first-party reporters for the following test runners. Configuration and installation details live in each reporter’s upstream README.

JavaScript

Playwright Test · Vitest · Jest · CucumberJS

Python

Pytest

Java

JUnit XML

Custom

Custom Integration ↓

Custom Integration

If none of the first-party reporters fit, you have three options:

1. Use JUnit XML. Most test runners can emit JUnit XML. Convert and upload it via the Flakiness CLI. See Migrating from JUnit XML.

2. File an issue. Request an official integration on the flakiness-feedback repo.

3. Write your own. If you’re on Node.js, use the Node.js SDK, which handles git detection, CI detection, and report upload. Otherwise, generate reports that conform to the Flakiness JSON Report specification.