Test Execution

In the Test Execution app, you can execute the test cases that have been prepared in the Test Preparation app, and track the progress of the test execution.

As a tester, you can execute manual and automated test cases:

  • Manual Test Cases: Assign statuses and enter comments for individual test actions based on observed application behavior in relation to the expected result, assign defects

  • Automated Test Cases: Trigger the execution of automated test cases in the connected test automation tool, assign defects

As a testing expert, you can monitor the progress and the outcomes both of manual test runs executed in SAP Cloud ALM, and of automated test runs executed in the connected test automation tool. In detail, the following options are available:

  • Display a history of all executed manual and automated test runs

  • Gain insight into all actions that are performed during manual test runs, and into their statuses

  • View the overall status of a test run, as well as the statuses of individual manual test actions

  • Access information about detected errors

  • Navigate to the connected test automation tool for more information

In the test execution, you can execute manual test cases that you've created in the test preparation.

Once the preparation status of your manual test case is Prepared, the test case appears in the Test Execution Overview.

You can then execute it as follows:

  1. Choose Execute.

    This creates a new test run for the selected manual test case.

  2. Carry out the instructions of the individual test actions and check whether the behavior of the application matches the expected result.

    Some actions may require you to access the application, which you can do by choosing Application or by selecting an option in the dropdown list.

  3. For each action, assign a status based on the observed result.

    You can choose between two Pass statuses and four Fail statuses. If you choose one of the Fail statuses, you are required to enter a comment to specify the error you've observed.

    The statuses of the actions influence the overall status of the test case.

  4. If you've found an error, you can create a defect for it in the Defects app and assign it to the affected test runs.

  5. After you've executed all test actions and want to complete the current test run, choose Finish Test Run.

Once you've executed the manual test run, the testing expert can view the results and address potential defects you've discovered.

 

In the test execution, you can execute automated test cases from the connected test automation tool.

Before an automated test case can appear in the Test Execution Overview, the following prerequisites have to be met:

Once your automated test case appears in the list, you can execute it as follows:

  1. Choose Execute.

    The test execution is now requested in the test automation tool.

    You can only execute an automated test case if no execution of this test case is currently running.

  2. If the request is successful, a new test run will be created for the selected automated test case. It is executed directly in the test automation tool.

  3. Once the execution has started, you can track the status and the progress of the test run from the Test Execution Overview.

  4. You can refresh the status and the progress of the test run by choosing  (Refresh Test Progress from the Test Automation Tool).

  5. If the automated test case finished with a fail status, you can create a defect for it in the Defects app and assign it to the affected test runs.

  6. Click on the line of the test case to see a list of all of the associated executed test runs.

    From here, you can also navigate directly to the test automation tool to view the execution log for more detailed information about potential errors.

You can get an overview of all available test cases of your project, along with relevant information about the current or the most recent execution of the test case.

Tip: If this list is empty, no test cases are currently available for testing. You can create test cases in the Test Preparation app.

Based on your project role, you can perform the following activities here:

  • As a tester, you can execute manual and automated test cases.

    For manual test cases, simply choose Execute and execute a test run right here, in this app. For more information, have a look at the section Executing Manual Test Cases.

    The execution of automated test cases can also be triggered by choosing Execute, but takes place directly in the test automation tool. For more information, have a look at the section Executing Automated Test Cases

  • As a testing expert, you can follow the progress of the test execution.

    To take a look at a history of all performed test runs, select a test case row. From there, you can navigate directly into the test run or, in the case of automated test cases, to the test automation tool.

    For manual test cases, you can also gain deeper insights by navigating to the open or last closed test run and looking at the statuses and comments for individual test actions.

    You can go back and edit your test cases by choosing  (Edit in Test Preparation App).

You can see the data variants for your automated test cases as they've been defined in the connected test automation tool.

Some test automation tools don't use the concept of data variants, in which case this column is empty.

If a data variant has been deleted since the last test run, it is labeled as Obsolete and is no longer accessible or executable. You can still view past executions for this variant under Executed Test Runs.