Independent Feedback Method for Program Field Test
Original Publication Date: 1981-Jan-01
Included in the Prior Art Database: 2005-Feb-10
It is common practice to evaluate major new programming products by a "Field Test" in which typical installations use the product and record problems and recommendations. The installation feedback is often by periodic reports and/or interviews. In addition, standard operation system statistics, e.g., system management facility (SMF) records, may be gathered for later analysis. The standard system accounting output (e.g., SMF) is frequently too broad to be very useful for evaluating a particular software product. User feedback is subject to many types of bias. Another way of obtaining specific, objective feedback is to have the product under test collect its own statistics and record them in such a manner that the user cannot readily examine them.