Browse Prior Art Database

Dependent success rate metric for product quality to be used throughout the whole development cycle Disclosure Number: IPCOM000230617D
Publication Date: 2013-Aug-27
Document File: 1 page(s) / 55K

Publishing Venue

The Prior Art Database


In agile development it is a must have to know each product build quality. The product quality image may be unclear taking into account all available factors like: number of defects, passed test points, number of executed test cases, number of failed test cases etc. The management needs to have a simple/single metric telling all about product quality from build to build. Such metric should take into consideration all available information.

This text was extracted from a PDF file.
This is the abbreviated version, containing approximately 75% of the total text.

Page 01 of 1

Dependent success rate metric for product quality to be used throughout the whole development cycle

Product health hot map calculated basing on single metric called "hot factor". Such map shows hot factors per each test type and for each build. Single metric (hot factor) representing the quality of a current build is calculated basing on automated tests: build-level tests (BVT), regression tests (RVT), integration tests (IVT), performance tests (PVT), system tests (SVT), migration tests (MIGR). Such map answers the question if the current build could be released immediately and if not - what part/aspect of the product still needs some work. Single dependent success rate metric called "Hot factor" is calculated according to the following formula:

Total value is calculated as mean value of each test type Hot Factor.

This single metric can take into consideration both automated and manual test scenario execution. First part of the formula (attempted vs total/planned points) represents the idea that tests that were not yet executed increase the risk of them not passing and thus build having defects. Only when tests are actually executed and they pass can one assume that a given build is free of problems.

The second part of the equation assumes test scenarios (both automatic and manual) consist of a series of steps and therefore both success rates should contribute to the hot factor. Success test cases means the percentage of whole test cases finishing without a sing...