A Method of Minimum Reusability Estimation for Automated Software Testing

doi:10.1007/s12204-013-1406-1

Abstract

Abstract: Through reusing software test components, automated software testing generally costs less than manual software testing. There has been much research on how to develop the reusable test components, but few fall on how to estimate the reusability of test components for automated testing. The purpose of this paper is to present a method of minimum reusability estimation for automated testing based on the return on investment (ROI) model. Minimum reusability is a benchmark for the whole automated testing process. If the reusability in one test execution is less than the minimum reusability, some new strategies must be adopted in the next test execution to increase the reusability. Only by this way, we can reduce unnecessary costs and finally get a return on the investment of automated testing.

摘要： Through reusing software test components, automated software testing generally costs less than manual software testing. There has been much research on how to develop the reusable test components, but few fall on how to estimate the reusability of test components for automated testing. The purpose of this paper is to present a method of minimum reusability estimation for automated testing based on the return on investment (ROI) model. Minimum reusability is a benchmark for the whole automated testing process. If the reusability in one test execution is less than the minimum reusability, some new strategies must be adopted in the next test execution to increase the reusability. Only by this way, we can reduce unnecessary costs and finally get a return on the investment of automated testing.

CLC Number:

TP 311.5

KAN Hong-xing1 (阚红星), WANG Guo-qiang1* (王国强),WANG Zong-dian1 (王宗殿), DING Shuai2 (丁帅). A Method of Minimum Reusability Estimation for Automated Software Testing[J]. Journal of shanghai Jiaotong University (Science), 2013, 18(3): 360-365.

References

[1] Eickelmann N S, Richardson D J. An evaluation of software test environment architectures [C]//Proceedings of 18th International Conference on Software Engineering. Berlin, Germany: IEEE Computer Society Press, 1996: 353-364.
[2] Beizer B. Software testing techniques [M]. London: Van Nostrand Reinhold (International) Co. Ltd., 1990: 1-26.
[3] de Oliveira J C, Gouveia C C, Filho R Q. Test automation viability analysis method [EB/OL]. (2008-08-10). http://www.cesar.org.br/pdf/TestAutomationViabilityAnalysisMethod.pdf.
[4] Liu L, Zhou X S, Gu J H, et al. Agent-based automated compatibility software test for NLSF [C]//Proceedings of the Second International Conference on Machine Learning and Cybernetics. Xi’an, Shaanxi, China: IEEE Press, 2003: 1986-1989.
[5] Brooks F P. Essence and accidents of software engineering [J]. Computer, 1987, 20(4): 10-19.
[6] Hoffman D. Cost benefits analysis of test automation [C]//Software Testing Analysis & Review Conference (STARW ’99). Orlando, FL: Software Quality Methods, LLC, 1999.
[7] Kelly M. The ROI of test automation [EB/OL]. (2005-06-24). http://www.stickyminds.com/getfile. asp?ot=XML&id=8502&fn=XDD8502filelistfilename1.pdf.
[8] Lonngren D D. Reducing the cost of test through reuse [C]// IEEE Systems Readiness Technology Conference (AUTOTESTCON’98). Salt Lake City, UT, USA: IEEE Press, 1998: 48-53.
[9] Rankin C. The software testing automation framework [J]. IBM System Journal, 2002, 41(1): 126-139.
[10] Cashar E E. Development of a TPS reuse library using COTS tools [J]. IEEE Aerospace and Electronic Systems Magazine, 1997, 12(10): 12-16.
[11] Sundmark D, Pettersson A, Thane H. Regression testing of multi-tasking real-time systems: A problem statement [J]. ACM SIGBED Review, 2005, 2(2): 31-34.
[12] Skoglund M, Runeson P. A case study on regression test suite maintenance in system evolution [C]//Proceedings of 20th IEEE International Conference on Software Maintenance (ICSM ’04). Los Alamitos, CA, USA: IEEE Computer Society Press, 2004: 438-442.
[13] Fewster M, Graham D. Software test automation [M]. New York, USA: Addison-Wesley, 1999: 9-18.
[14] Boehm B W. Software engineering economics [J]. IEEE Transactions on Software Engineering, 1984, SE-10(1): 4-21.

[1]	XIAO Pengfei, NI He, JIN Jiashan. Sequential Prediction Method of Single Parameter for Thermal System Based on MWSA [J]. Journal of Shanghai Jiao Tong University, 2023, 57(1): 36-44.
[2]	ZHANG Guangming, LEI Yu, CHEN Houpeng, YU Qiuyao, SONG Zhitang. A Circuit Simulation Model of 1S1R for 3D Phase-Change Memory [J]. Journal of Shanghai Jiao Tong University, 2022, 56(12): 1649-1657.
[3]	LIU Mingguang, LIAO Yaxuan, LI Xiangshun . Data-Driven Fault Detection of Three-Tank System Applying MWAT-ICA [J]. J Shanghai Jiaotong Univ Sci, 2020, 25(5): 659-664.
[4]	BESSAAD Nassim, BAO Qilian, SUN Shuodong, DU Yuding, LIU Lin, HASSAN Mahmood Ul . Adaptive Dual Wavelet Threshold Denoising Function Combined with Allan Variance for Tuning FOG-SINS Filter [J]. Journal of Shanghai Jiao Tong University(Science), 2020, 25(4): 434-440.
[5]	WANG Ning (王宁), ZHANG Zhuo (张卓). Feature Recognition and Selection Method of the Equipment State Based on Improved Mahalanobis-Taguchi System [J]. Journal of Shanghai Jiao Tong University (Science), 2020, 25(2): 214-222.
[6]	WEI Bingzhuo, LIU Xin, CAO Zheng, FAN Haizhou, YANG Gang. A Two-dimensional Track Correlation Method Based on Statistics [J]. Air & Space Defense, 2020, 3(1): 93-98.
[7]	ZHANG Ke (张珂), LIN Tianran (林天然), JIN Xia (金霞) . Low Speed Bearing Fault Diagnosis Based on EMD-CIIT Histogram Entropy and KFCM Clustering [J]. Journal of Shanghai Jiao Tong University (Science), 2019, 24(5): 616-621.
[8]	WENG Paul1,2*, QIU Zeqi3 (邱泽麒), COSTANZO John3, YIN Xiaoqi3 (阴小骐), SINOPOLI Bruno3. Optimal Threshold Policies for Robust Data Center Control [J]. Journal of Shanghai Jiao Tong University (Science), 2018, 23(1): 52-60.
[9]	JIANG Huajuna,CAI Yana,b,LI Chaohaoa,LI Fanga,b,HUA Xueminga,b. Recognition Method for Gas Pores on XRay Image of Lap Joints Based on the Improved Sobel Algorithm [J]. Journal of Shanghai Jiaotong University, 2017, 51(6): 665-671.
[10]	LI Xi,ZHANG Kaisheng,YANG Zili,LIAN Zhiwei. Indoor Air Quality Affected by Ultrasonic Atomization Liquid#br# Desiccant Dehumidification System [J]. Journal of Shanghai Jiaotong University, 2017, 51(3): 257-.
[11]	CUI Yan* (崔妍), CHEN Shijun (陈世均), QU Meng (瞿勐), HE Shanhong (何善红). Research and Application of New Threshold De-noising Algorithm for Monitoring Data Analysis in Nuclear Power Plant [J]. Journal of shanghai Jiaotong University (Science), 2017, 22(3): 355-360.
[12]	LIU Jinhai* (刘金海), MA Yanjuan (马艳娟), WU Zhenning (吴振宁), WANG Gang (汪刚). Real-Time Pressure Based Diagnosis Method for Oil Pipeline Leakage [J]. Journal of shanghai Jiaotong University (Science), 2017, 22(2): 233-239.
[13]	BAI Caijuan1,LIU Jing1,JIANG Xiaoyu2,ZHANG Guoxian1,HUANG Kaiyu1. The Reconstruction of Digital Holography Based on Iterative De-Noising Shrinkage-Thresholding Algorithm [J]. Journal of Shanghai Jiaotong University, 2017, 51(12): 1435-1442.
[14]	LIAN Zhichaoa,b* (练智超), SONG Jiea (宋杰), LI Yanga (李杨). Adaptive Illumination Normalization Approach Based on Denoising Technique for Face Recognition [J]. Journal of shanghai Jiaotong University (Science), 2017, 22(1): 45-049.
[15]	ZHENG Xiaoya1*(郑晓亚), YOU Haibo2 (尤海波). Do China Mainland and SARs Constitute an Optimal Currency Area? Evidence from Nonlinearity and Stationarity Behavior Testing on Real Exchange Rates [J]. Journal of shanghai Jiaotong University (Science), 2016, 21(3): 328-334.