Breadcrumbs

XRay Test Runs levels in Jira Snapshots

If you use XRay Test Management for Jira you can use Jira Snapshots to create test reports.

Many details of Test Runs can be included in their own type of level: a Test Run level.

With a Test Run level:

  1. You can include the data related to the test runs of the test. For test issues in a certain level, if the next level is a Test Runlevel, then the test run data of that test will be included in the test run level.

  2. You can filter which test runs are included in the level. The inclusion is a combination of these criteria:

    1. All, or only the latest test run

    2. Test runs associated with specific versions

    3. Test runs associated with specific test environments

  3. You can include many fields which are specific to test runs.

image-20221108-185253.png


How to configure a “Test Run level”

A test run level is always the last level, but it cannot be the 1st level.

Once a test run level is set, a subsequent level cannot be added.

  1. Start by creating a level to retrieve the Xray test issues you need.

    image-20250814-144214.png

    Once the test level is configured, add a new level

  2. To configure the new level as a Test Runs level:

    1. Set the level type to be “Test Runs”

    2. Use the available criteria to filter which test runs will be included

    3. Set the fields to display

The available criteria to filter test runs

Criteria

Effect

1

Search JQL

The JQL will be applied on the test execution’ issue that the test run belongs to.

For example, “Status=Done” will have the impact that only test runs belonging to test executions that are in status Done will be included.

2

Select Test Runs: All/Latest

  • All: Test runs that correspond with the other criteria will be retrieved.

  • Latest: A Maximum of a single test run is included. This will be the most recent test run that corresponds with the other criteria.

3

Test Runs Statuses

Test Runs need to be in one of the specified statuses. If empty, all statuses are retrieved.

This is a good criterion to use if you want to exclude, for example, FAILED runs.

4

Fix versions

Only test runs associated with any of the versions specified will be considered.

If empty, this criterion is ignored.

Note: the ‘versions' field on the test run is inheriting its value from the 'Fix versions' field of the test execution.

5

Test environments

Only test runs associated with any of the Test environments specified will be considered.

If empty, this criterion is ignored.


image-20250814-143824.png

Fields available for test runs

Select from the list of fields:

  • Link to test run

  • Test key

  • Test execution key

  • Test Execution Status

  • Test Execution Summary

  • Test environments

  • Fix versions - this is the ‘versions’ field in the Xray interface (we use the Jira naming here)

  • Status

  • Revision

  • Assignee

  • Executed by

  • Defect - optionally, this field will also display the Defect status. See configuration option under the tab ‘Test Runs Level Layout’ (and screen capture below)

  • Eidences

  • Started on

  • Finished on

  • Comment

  • Gherkin

  • Definition

  • Test version - applicable for Xray Enterprise

image-20250814-143915.png
image-20250814-144026.png