Enhancing software reliability modeling and prediction through the introduction of time-variable fault reduction factor. (English) Zbl 1202.90102
Summary: Over the past three decades, many software reliability models with different parameters, reflecting various testing characteristics, have been proposed for estimating the reliability growth of software products. We have noticed that one of the most important parameters controlling software reliability growth is the fault reduction factor (FRF) proposed by Musa. FRF is generally defined as the ratio of net fault reduction to failures experienced. During the software testing process, FRF could be influenced by many environmental factors, such as imperfect debugging, debugging time lag, etc. Thus, in this paper, we first analyze some real data to observe the trends of FRF, and consider FRF to be a time-variable function. We further study how to integrate time-variable FRF into software reliability growth modeling. Some experimental results show that the proposed models can improve the accuracy of software reliability estimation. Finally, sensitivity analyses of various optimal release times based on cost and reliability requirements are discussed. The analytic results indicate that adjusting the value of FRF may affect the release time as well as the development cost.
MSC:
| 90B25 | Reliability, availability, maintenance, inspection in operations research |
| 68N30 | Mathematical aspects of software engineering (specification, verification, metrics, requirements, etc.) |
| 62N05 | Reliability and life testing |
Keywords:
fault reduction factor (FRF); software reliability growth model (SRGM); software testing; non-homogeneous Poisson process (NHPP); optimal release timeSoftware:
CARATSReferences:
| [1] | Xie, M., Software Reliability Modeling (1991), World Scientific Publishing · Zbl 0824.68025 |
| [2] | Pham, H., Software Reliability (2000), Springer · Zbl 0943.68007 |
| [3] | Lyu, M. R., Handbook of Software Reliability Engineering (1996), McGraw-Hill |
| [4] | P. Carnes, Software reliability in weapon systems, in: Proceedings of the 8th International Symposium On Software Reliability Engineering (ISSRE 1997), Albuquerque, NM, USA, November 1997, pp. 114-115.; P. Carnes, Software reliability in weapon systems, in: Proceedings of the 8th International Symposium On Software Reliability Engineering (ISSRE 1997), Albuquerque, NM, USA, November 1997, pp. 114-115. |
| [5] | Schneidewind, N. F.; Keller, T. W., Application of reliability models to the space shuttle, IEEE Softw., 9, 4, 28-33 (1992) |
| [6] | Almering, V.; van Genuchten, M.; Cloudt, G.; Sonnemans, P. J.M., Using software reliability growth models in practice, IEEE Softw., 24, 6, 82-88 (2007) |
| [7] | Ehrlich, W. K.; Lee, K.; Molisani, R. H., Applying reliability measurements: a case study, IEEE Softw., 7, 2, 56-64 (1990) |
| [8] | W.D. Jones, Reliability models for very large software systems in industry, in: Proceedings of the Second International Symposium on Software Reliability Engineering (ISSRE 1991), Austin, TX, USA, May 1991, pp. 35-42.; W.D. Jones, Reliability models for very large software systems in industry, in: Proceedings of the Second International Symposium on Software Reliability Engineering (ISSRE 1991), Austin, TX, USA, May 1991, pp. 35-42. |
| [9] | Musa, J. D., A theory of software reliability and its application, IEEE Trans. Softw. Eng., SE-1, 3, 312-327 (1975) |
| [10] | Musa, J. D.; Iannino, A.; Okumoto, K., Software Reliability: Measurement, Prediction, Application (1987), McGraw-Hill |
| [11] | Musa, J. D., The measurement and management of software reliability, Proc. IEEE, 68, 9, 1131-1143 (1980) |
| [12] | Musa, J. D., Software Reliability Engineering: More Reliable Software, Faster and Cheaper (2004), Authorhouse |
| [13] | P.A. Hamilton, J.D. Musa, Measuring reliability of computation center software, in: Proceedings of the Third International Conference on Software Engineering (ICSE 1978), Atlanta, GA, USA, May 1978, pp. 29-36.; P.A. Hamilton, J.D. Musa, Measuring reliability of computation center software, in: Proceedings of the Third International Conference on Software Engineering (ICSE 1978), Atlanta, GA, USA, May 1978, pp. 29-36. |
| [14] | M.J. Fries, Software Error Data Acquisition, Technical Report, Rome Air Development Center, 1977, RADC-TR-77-130.; M.J. Fries, Software Error Data Acquisition, Technical Report, Rome Air Development Center, 1977, RADC-TR-77-130. |
| [15] | D.M. Weiss, Evaluating Software Development by Analysis of Change Data, Computer Science Technical Report, University of Maryland, 1981, TR-1120.; D.M. Weiss, Evaluating Software Development by Analysis of Change Data, Computer Science Technical Report, University of Maryland, 1981, TR-1120. |
| [16] | Basili, V. R.; Perricone, B. T., Software errors and complexity: an empirical investigation, Commun. ACM, 27, 1, 42-52 (1984) |
| [17] | Friedman, M. A.; Tran, P. Y.; Goddard, P. L., Reliability of Software Intensive Systems (1995), Noyes Publications |
| [18] | K. Wu, Y.K. Malaiya, The effect of correlated faults on software reliability, in: Proceedings of the 4th International Symposium on Software Reliability Engineering (ISSRE 1993), Denver, CO, USA, November 1993, pp. 80-89.; K. Wu, Y.K. Malaiya, The effect of correlated faults on software reliability, in: Proceedings of the 4th International Symposium on Software Reliability Engineering (ISSRE 1993), Denver, CO, USA, November 1993, pp. 80-89. |
| [19] | M.C. Chen, H.P. Wu, H.J. Shyur, Analyzing software reliability growth model with imperfect-debugging and change-point by genetic algorithms, in: Proceedings of the 29th International Conference on Computers and Industrial Engineering (ICC&IE 2001), Montreal, Canada, November 2001, pp. 520-526.; M.C. Chen, H.P. Wu, H.J. Shyur, Analyzing software reliability growth model with imperfect-debugging and change-point by genetic algorithms, in: Proceedings of the 29th International Conference on Computers and Industrial Engineering (ICC&IE 2001), Montreal, Canada, November 2001, pp. 520-526. |
| [20] | Jones, C., Software defect-removal efficiency, IEEE Comput., 29, 4, 94-95 (1996) |
| [21] | Zhang, X.; Shin, M. Y.; Pham, H., Exploratory analysis of environmental factors for enhancing the software reliability assessment, J. Syst. Softw., 57, 1, 73-78 (2001) |
| [22] | Chiu, K. C.; Huang, Y. S.; Lee, T. Z., A study of software reliability growth from the perspective of learning effects, Reliab. Eng. Syst. Saf., 93, 10, 1410-1421 (2008) |
| [23] | Kapur, P. K.; Goswami, D. N.; Bardhan, A.; Singh, O., Flexible software reliability growth model with testing effort dependent learning process, Appl. Math. Model., 32, 7, 1298-1307 (2008) · Zbl 1183.68194 |
| [24] | Goel, A. L., Software reliability models: assumptions, limitations, and applicability, IEEE Trans. Softw. Eng., 11, 12, 1411-1423 (1985) |
| [25] | Huang, C. Y.; Lyu, M. R.; Kuo, S. Y., A unified scheme of some nonhomogenous poisson process models for software reliability estimation, IEEE Trans. Softw. Eng., 29, 3, 261-269 (2003) |
| [26] | M. Ohba, X.M. Chou, Does imperfect debugging affect software reliability growth? in: Proceedings of the 11th IEEE International Conference on Software Engineering (ICSE 1989), Pittsburgh, PA, USA, May 1989, pp. 237-244.; M. Ohba, X.M. Chou, Does imperfect debugging affect software reliability growth? in: Proceedings of the 11th IEEE International Conference on Software Engineering (ICSE 1989), Pittsburgh, PA, USA, May 1989, pp. 237-244. |
| [27] | Lin, C. T.; Huang, C. Y., Enhancing and measuring the predictive capabilities of testing-effort dependent software reliability models, J. Syst. Softw., 81, 6, 1025-1038 (2008) |
| [28] | Wu, Y. P.; Hu, Q. P.; Xie, M.; Ng, S. H., Modeling and analysis of software fault detection and correction process by considering time dependency, IEEE Trans. Reliab., 56, 4, 629-642 (2007) |
| [29] | Tamura, Y.; Yamada, S., A flexible stochastic differential equation model in distributed development environment, Eur. J. Oper. Res., 168, 1, 143-152 (2006) · Zbl 1077.90020 |
| [30] | T.M. Khoshgoftaar, T.G. Woodcock, Software reliability model selection: a case study, in: Proceedings of the Second IEEE International Symposium on Software Reliability Engineering (ISSRE 1991), Austin, TX, USA, May 1991, pp. 183-191.; T.M. Khoshgoftaar, T.G. Woodcock, Software reliability model selection: a case study, in: Proceedings of the Second IEEE International Symposium on Software Reliability Engineering (ISSRE 1991), Austin, TX, USA, May 1991, pp. 183-191. |
| [31] | Ohba, M., Software reliability analysis models, IBM J. Res. Dev., 28, 4, 428-443 (1984) |
| [32] | Malaiya, Y. K.; von Mayrhauser, A.; Srimani, P. K., An examination of fault exposure ratio, IEEE Trans. Softw. Eng., 19, 11, 1087-1094 (1993) |
| [33] | N. Li, Y.K. Malaiya, Fault exposure ratio estimation and applications, in: Proceedings of the Seventh International Symposium on Software Reliability Engineering (ISSRE 1996), White Plains, NY, USA, November 1996, pp. 372-381.; N. Li, Y.K. Malaiya, Fault exposure ratio estimation and applications, in: Proceedings of the Seventh International Symposium on Software Reliability Engineering (ISSRE 1996), White Plains, NY, USA, November 1996, pp. 372-381. |
| [34] | Musa, J. D., Rationale for fault exposure ratio \(K\), ACM SIGSOFT Softw. Eng. Notes, 16, 3, 79 (1991) |
| [35] | Shyur, H. J., A stochastic software reliability model with imperfect-debugging and change-point, J. Syst. Softw., 66, 2, 135-141 (2003) |
| [36] | Chang, Y. C.; Liu, C. T., A generalized JM model with applications to imperfect debugging in software reliability, Appl. Math. Model., 33, 9, 3578-3588 (2009) · Zbl 1185.68239 |
| [37] | Huang, C. Y.; Lin, C. T., Software reliability analysis by considering fault dependency and debugging time lag, IEEE Trans. Reliab., 55, 3, 436-450 (2006) |
| [38] | Xie, M.; Hu, Q. P.; Wu, Y. P.; Ng, S. H., A study of the modeling and analysis of software fault-detection and fault-correction processes, Qual. Reliab. Eng. Int., 23, 4, 459-470 (2007) |
| [39] | Lo, J. H.; Huang, C. Y., An integration of fault detection and correction processes in software reliability analysis, J. Syst. Softw., 79, 9, 1312-1323 (2006) |
| [40] | Keller, G., Statistics for Management and Economics (2008), South-Western College |
| [41] | SourceForge.net, An Open Source Software Website. 2008. Available from: <http://sourceforge.net>; SourceForge.net, An Open Source Software Website. 2008. Available from: <http://sourceforge.net> |
| [42] | K.Z. Yang, An Infinite Server Queueing Model for Software Readiness Assessment and Related Performance Measures, Ph.D. Dissertation, Department of Electrical Engineering and Computer Sciencein, Syracuse University, NY, USA, 1996.; K.Z. Yang, An Infinite Server Queueing Model for Software Readiness Assessment and Related Performance Measures, Ph.D. Dissertation, Department of Electrical Engineering and Computer Sciencein, Syracuse University, NY, USA, 1996. |
| [43] | Huang, C. Y., Cost-reliability-optimal release policy for software reliability models incorporating improvements in testing efficiency, J. Syst. Softw., 77, 2, 139-155 (2005) |
| [44] | Huang, C. Y.; Lin, C. T., Analysis of software reliability modeling considering testing compression factor and failure-to-fault relationship, IEEE Trans. Comput., 59, 2, 283-288 (2010) · Zbl 1368.68180 |
| [45] | X. Li, M. Xie, S.H. Ng, Sensitivity Analysis of Release Time of Software Reliability Models Incorporating Testing Effort with Multiple Change-Points, Applied Mathematical Modelling, in press. doi:10.1016/j.apm.2010.1003.1000.; X. Li, M. Xie, S.H. Ng, Sensitivity Analysis of Release Time of Software Reliability Models Incorporating Testing Effort with Multiple Change-Points, Applied Mathematical Modelling, in press. doi:10.1016/j.apm.2010.1003.1000. · Zbl 1201.68038 |
| [46] | C.C. Chen, C.T. Lin, H.H. Huang, S.W. Huang, C.Y. Huang, CARATS: a computer-aided reliability assessment tool for software based on object-oriented design, in: Proceedings of IEEE Region 10 Conference (TENCON 2006), Hong Kong, China, November 2006, pp. 1-4.; C.C. Chen, C.T. Lin, H.H. Huang, S.W. Huang, C.Y. Huang, CARATS: a computer-aided reliability assessment tool for software based on object-oriented design, in: Proceedings of IEEE Region 10 Conference (TENCON 2006), Hong Kong, China, November 2006, pp. 1-4. |
This reference list is based on information provided by the publisher or from digital mathematics libraries. Its items are heuristically matched to zbMATH identifiers and may contain data conversion errors. In some cases that data have been complemented/enhanced by data from zbMATH Open. This attempts to reflect the references listed in the original paper as accurately as possible without claiming completeness or a perfect matching.
