Test environment tracking with labels (tags)

When executing tests, it is often really important to track detailed information about the environment and / or the system under test.

Example A: Testing a Webshop

When testing a web shop process, it could be important to track the

• Browser (possibly including version)

• Operating System

• Payment provider API Version

• deployed Shop Modules

Example B: Testing a health monitor watch

When testing a health monitoring device, it could be important to track the

• Prototype Number

• Software Version

• Firmware Version

• Sensor Type

• Test chamber A

  consisting of

  • National Instruments Testing Device A

  • Rohde & Schwarz Measuring Device B

  • …

  • Fluke Oscilloscope Z

Of course, it’s always possible to just put this information to the ‘actual result’ of a test case. But this approach has downsides when it comes to Analysis & Reporting. The information is there but hidden.

Now you can add your own fields to the Test run configurator in the Project Template settings.

Enter aqua Test Execution Labels

With aqua Test Execution Labels, testers can easily track detailed information like given in the examples above:

Labels can represent

• Information about the System under Test / Application under Test / Device under Test

• Information about the Test Environment

• any other information about the executed test

How to add a new label

New labels can be added in the run configuration before the execution or in the execution himself. To add a new label, klick on the and start typing to create a new label.

Adding an existing label

To add an existing label also klick on the and search/select for an existing label. With a click on it, it will be shown in the pool of selected labels. The already selected labels are highlighted in gray.

Adding an existing label

Editing Labels

To edit a label, klick on it and select 'Edit'.

This is possible in the run configuration and in unfinished executions. The name can be changed in this window. It is also possible to add a short description and to add sub-labels in the form of new or existing labels.

Note: Changing the name or description does not affect old, existing executions that used the same label.

Super Labels aka Complex Labels

Deleting Labels

Deleting a label removes it from the pool of labels presented to users in the autocomplete dialog box. Cleaning up the list of labels by deleting old or misspelled labels can make it easier and faster for the team to find and use the correct labels.

Important information: Deleting a label will never remove the label from existing trials! So even if you delete a label, your old test-runs are safe and unaffected.