Ensuring Quality

Objectives
After completing this lesson, you will be able to:

After completing this lesson, you will be able to:

  • Summarize how SAP Cloud ALM orchestrates all manual and automatic testing activities, including defect management and reporting

Recommendations for the Management of All Test Activities

At Dreams without Limits, Tess Ter is responsible for managing testing and defect resolution plans. She knows that a good test strategy is key for the quality of the business processes.

She therefore sets up a meeting with Carl Consultant and Joana Junior from Implement HXM! to ask them for the test capabilities of SAP Cloud ALM.

Manage All Tests in One Central Place

Carl points out that the main goal of Test Management with SAP Cloud ALM is to prepare and execute tests based on SAP content for manual testing and integration of automated testing tools. It consists of two parts:

  • Test planning and orchestration (among others) include both the preparation of tests for manual and automated test cases and the orchestration of testing across different test types and test automation providers. In addition, it allows Tess to plan and structure her test execution using Test Plans and to prepare the test on requirements that are based on the business processes.
  • Test execution among others includes the execution of manual, step-based test cases as well as the integration of test automation providers. For example, SAP S/4HANA offers the SAP S/4HANA Test Automation Tool, and SAP Cloud ALM offers Tricentis Test Automation for SAP.

Tess is quite familiar with test management and test execution, but she is not quite sure what Joana means by "test orchestration". Joana explains that test orchestration means setting up a well-defined sequence of manual and automated test activities – for example, when new features of the software are marked as ready for release at the end of a sprint.

After this question, Joana continues that, depending on the SAP Solution, it might be able to import test scripts from SAP Best Practice content.

Hint

For more information, see the blog How to import Test Scripts from the SAP Best Practice content for SAP S/4 HANA Cloud into SAP Cloud ALM manual test cases that describes a way for SAP S/4HANA Cloud, which is part of the Hire to Retire scenario at Dreams without Limits.

Joana then invites Tess to discuss the requirements for test concepts. Tess walks to the whiteboard and, together with Joana, creates the following table:

ConceptDetails
Lean

Simple Concepts

No complexity overhead

Agile

Test as soon as possible

Test as fast as possible

Flexible Test Levels

Test with a purpose

Relation to process, requirement and / or user story to achieve traceability

Process-Oriented

Derive the structure from the process flow

Derive the content from the process assets (where available)

Add test actions

Rich text support

At the end of this discussion, Joana explains that Test Management in SAP Cloud ALM offers all the concepts from the table. It uses Test Plans for advanced test orchestration.

Note

Test Management in SAP Cloud ALM supports multiple test cycles or roll-outs to multiple organizations re-using the same set or similar sets of test cases.

Tess then continues that the traceability of tests is an important topic at Dreams without Limits. Together with Anna Lyze, who is responsible for analytics, and who has just joined the meeting, she needs to make sure that all test activities can be traced, and their results can be evaluated.

Orchestration Via Traceability

Test Orchestration

In the next meeting, Tess wants to know more about the main objectives and capabilities of SAP Cloud ALM Test Management and the test orchestration.

SAP Cloud ALM Test Orchestration

Joana highlights that Test Management in SAP Cloud ALM could be used both for cloud solutions (which Dreams without Limits are implementing) and for on premise solutions. Although it is designed for SAP solutions, it can also be used for manual testing of non-SAP components that are included in the business processes.

She continues that the manual testing is fully available with test preparation features, test execution and all the analytic features. The creation of manual test cases is done based on the business activities from the selected business process flow. Consequently, the relevant business activities should be scoped so that they can be included in the test case.

The test automation framework is used by the test automation tool for SAP S/4HANA Cloud (which offers a full automation suite for SAP S/4HANA Cloud that can be integrated into SAP Cloud ALM).

Note

This means that the orchestration part can be performed from within SAP Cloud ALM, but the engineering part (such as updating or managing the test scripts and test plans from an authoring point of view) is done in the test tool itself.

Finally, Joana comes to automated tests. She explains that third party test automation providers can be integrated via an API as well which means that the orchestration can be performed in SAP Cloud ALM. In the case of Tricentis Test Automation, even automated, re-usable test cases can be created in SAP Cloud ALM. Roughly speaking, this means that SAP Cloud ALM is the platform and Tricentis Test Automation is the engine for delivering automated tests to customers such as Dreams without Limits.

Note

For more information about Tricentis Test Automation for SAP, see the blog Tricentis Test Automation for SAP integrated with SAP Cloud ALM is now available. Concerning usage rights, see the corresponding section in SAP Support Portal.

Defect Management

From her experience, Tess knows that during the different tests, it is likely that many errors will be detected. Together with Anna, she therefore asks Joana how to handle errors that come up during testing:

Defect Management

Joana highlights that defects can be created directly from the test execution list. As a result, the defect and the test case are then automatically related for traceability and for seamless navigation. Defects contain many attributes such as scope, priority, status, due date and assigned role which further enhances the traceability.

She continues that Test Execution Analysis (which is available from the Analytics app) allows for the monitoring of test execution progress using different chart types. The included Executed Manual Test Analysis report provides visibility on the number of actions remaining (work to be done for testers) before a test run could be finished. The Defect Reporting (also available from the Analytics app) helps to monitor the progress of the defect resolution.

Note

The Analytics app also offers traceability views for processes (Solution Process Traceability), requirements (Requirement Traceability, for example to answer the question which requirements are ready for test execution or for deployment to production) and user stories (User Story Traceability).

Creating Defects

Log in to track your progress & complete quizzes