Browse Prior Art Database

Method of Automatic (Teach-In) Test Data Adjustment for Software Test Automation Tools

IP.com Disclosure Number: IPCOM000130738D
Original Publication Date: 2005-Nov-03
Included in the Prior Art Database: 2005-Nov-03
Document File: 3 page(s) / 291K

Publishing Venue

IBM

Abstract

This invention proposes a method to extend software test automation tools with functionality to adjust inaccessible expected test result values automatically (teach-in technique) and report the adjustments during first test execution instead of exploring software under test source code and updating test data manually. The Teach-In Technique extends software automatic test tools with ability to complete test data definition before the time when testing software can produce actual test result

This text was extracted from a PDF file.
At least one non-text object (such as an image or picture) has been suppressed.
This is the abbreviated version, containing approximately 52% of the total text.

Page 1 of 3

Method of Automatic (Teach-In) Test Data Adjustment for Software Test Automation Tools

ABSTRACT

This invention proposes a method to extend software test automation tools with functionality to adjust inaccessible expected test result values automatically (teach-in technique) and report the adjustments during first test execution instead of exploring software under test source code and updating test data manually. The Teach-In Technique extends software automatic test tools with ability to complete test data definition before the time when testing software can produce actual test results.

Disclosed is a method of Automatic (teach-in) Test Data Adjustment for software test automation tools. Quality assurance (QA) engineers develop automatic test scripts and data sets prior to the testing software being completely ready.

A problem appears when some test result values are not visible on the GUI (Graphical User Interface) and cannot be pulled from database or configuration files. Test automation developer has to access software under test source code to get expected values and save as expected results. Otherwise, some test scenarios cannot be automated until getting the testing software is first functioning build.

Test automation tool invokes Automatic (teach-in) Test Data Adjustment functionality to solve such problems. It offers a test data constant "ADJUST ON EXEC" to specify expected test result value that would be replaced by actual test result at the next execution.

Data Adjustment functionality contains following steps:
1) Check if test returns actual result
2) Detect inconsistency between expected and actual test result
3) Verify if expected value equals "ADJUST ON EXEC"
4) Replace the "ADJUST ON EXEC" by actual test result value
5) Report test data modifications

QA engineer just marks unknown test data as "ADJUST ON EXEC" and previews it's automatically updated value in report. Automatically adjusted test cases would not fail at this and next regressions.

The idea of Automatic...