Browse Prior Art Database

System and Method for Assigning Test Priority in a Cloud Environment

IP.com Disclosure Number: IPCOM000242989D
Publication Date: 2015-Sep-06
Document File: 4 page(s) / 76K

Publishing Venue

The IP.com Prior Art Database

Abstract

Disclosed is a method to provide a dynamic test infrastructure that continuously adapts to application usage patterns, platform changes, and test scenarios availability. This addresses the needs of all application developers and DevOps teams.

This text was extracted from a PDF file.
This is the abbreviated version, containing approximately 41% of the total text.

Page 01 of 4

System and Method for Assigning Test Priority in a Cloud Environment

As businesses become agile and adopt DevOps to achieve continuous delivery capabilities, standardized and extensible cloud platforms offer services and application patterns for essential application lifecycle management , to streamline both development and deployment in the cloud.

Cloud vendors that provide an open platform need to offer not only a broader spectrum of services and usage scenarios , but also the required testing infrastructure to accommodate dynamic and flexible scope coverage. The success of the cloud platform adoption depends on the ability to use real usage data to drive quality assurance needs of cloud applications assembled out of built-in and third party services and application patterns. The applications built in a cloud environment can be very complex and the usage tends to be different for each deployment.

Tools are available for continuous build, deploy, and test; however, an additional method is needed to identify the test path covered by customer usage and to use this information to prioritize the execution of test cases .

The novel contribution is a method to provide a dynamic test infrastructure that continuously adapts to application usage patterns , platform changes, and test scenarios availability. This addresses the needs of all application developers and DevOps teams. The solution focuses on ensuring better and more efficient test coverage by identifying which of the existing test cases should run , and how to better configure the test case input parameters to cover the application needs based on the application usage .

With this method, the system gathers the properties related to the type and configuration of a cloud deployed application pattern , and then searches for related information in the set of testcases provided by the cloud platform . Using application usage data, the system determines whether one or more testcases match the deployed configurations and updates the priority and weigh of the test based on match pattern. The system determines if test properties are not confidently covered by the existing testcases in

which case it flags the necessity to create new testcase.

The existing test cases are indexed based on the associated textual description and input and configuration parameters , and then queried based on keywords extracted from the application specific keywords (which include configuration parameters, etc.). The matched test cases are then assigned execution priority, including priority to certain set of values for the test parameters, based on application usage.

1


Page 02 of 4

The solution defines two methods for determining whether a user scenario is covered by any of the existing test cases . The first method is based on extracting keywords from a deployed workload configuration and using search technology to match it with related test case content. The second method compares the configuration paramete...