Collecting test data from other test runners

If a native Buildkite test collector is not available for your language or test runner, you can instead use any of the following mechanisms to integrate your particular test runner with Buildkite Test Engine:

Recommended setup

The recommended way to set up a new test suite is to add the Tests Buildkite plugin to the step that runs your tests. It works with every runner that bktec supports, and the entire setup is configuration-only. You can get a test suite running through changes to pipeline.yml alone, with no modifications to your application code.

Use the language-specific test collector documented on this page when you want deeper framework integration, such as custom execution tags, span annotations, or richer per-framework data. For a runner that bktec supports, you can use bktec to run and split tests while the collector uploads the results. To prevent duplicate test executions, set BUILDKITE_TEST_ENGINE_UPLOAD_RESULTS to false. If you use the Tests Buildkite plugin, set upload-results: false.