№1, 2024

Tamilla A. Bayramova, Nazakat C. Malikova

In the Industry 4.0 environment, the software systems development methodology is rapidly evolving, flexible technologies and new programming languages are being applied. The development of the software industry has made the issue of the quality of software systems an urgent problem. A number of quality models have been proposed for determining the quality of software systems so far, and these models specify the parameters and criteria for evaluating quality.  Software reliability is one of the key indicators among the quality parameters of software systems, as it quantifies software crashes which can bring down even the most powerful system, ensuring that software systems run correctly and unexpected incidents do not occur. The increasing difficulty of the software system, the expansion of the scope of issues assigned on them, and as a result, the significant increase in the volume and complexity of the software system have made the problem of the reliability of the software system even more urgent. The essence of the issue is to reveal the main factors affecting the reliability of software systems, demonstrate existing problems in this area and develop mathematical models for assessing reliability. Mathematical models estimate the number of errors remaining in the software system before commissioning, predict the time of occurrence of the next crash and when the testing process will end. It is necessary to comprehensively approach the issue of ensuring reliability at all stages of the life cycle of the software system. This paper proposes a conceptual model to solve this problem (pp.42-56).

Keywords:Software quality, Software reliability, Quality model, Classification of defects, Testing, Reliability model, Reliability parameters
  • Abdallah, M., Jaber, T., Alabwaini, N., & Abd Alnabi, A. (2019). A proposed quality model for the Internet of Things systems. In 2019 IEEE Jordan International Joint Conference on Electrical Engineering and Information Technology, 23-27.
  • Alaswad, F., & Poovammal, E. (2022). Software quality prediction using machine learning. Materials Today: Proceedings, 62, 4714-4720. https://doi.org/10.1016/j.matpr.2022.03.165.
  • Albeanu, G., Madsen, H., Popențiu-Vlădicescu, F. (2020). Computational Intelligence Approaches for Software Quality Improvement. Reliability and Statistical Computing: Modeling, Methods and Applications, 305-317.
  • Alguliyev, R. M. & Mahmudov R. Sh. (2019). Sensitive personal data in the national mentality context and its security provision. . Problems of Information Society, №2, 117–128.
  • Al-Qutaish, R. E. (2010). Quality models in software engineering literature: an analytical and comparative study. Journal of American Science, 6(3), 166-175.
  • Bayramova, T.A. (2020). Analysis of software engineering standards. Problems of Information Society, 11(1), 83–95.
  • Bayramova, T.A. & Abbasova N.P. (2016). Verification and validation of software / «Questions of application of mathematics and new information technologies» III republican scientific conference, Sumgayit, December 15, 197-198.
  • Bayramova, T.A. (2022). Classification of software defects. Proceedings of the III international scientific conference on information systems and technologies: achievements and perspectives, Sumgayit, 256-258.
  • Bayramova, T.A. (2022). Analysis of Modern Methods for Detecting Vulnerabilities in Software for Industrial Information Systems // Cybersecurity for Critical Infrastructure Protection via Reflection of Industrial Control Systems, NATO Science for Peace and Security Series D: Information and Communication Security. - Amsterdam, 160-162.
  • Boehm, B. W., Brown, J. R., Kaspar, H., Lipow, M., McLeod, G., Merritt, M. (1978). Characteristics of Software Quality. North Holland Publishing, Amsterdam, The Netherlands, 45-68, 169.
  • Brereton, P., Kitchenham, B. A., Budgen, D., Turner, M., Khalil, M. (2007). Lessons from applying the systematic literature review process within the software engineering domain. Journal of systems and software, 80(4), 571-583. https://doi.org/10.1016/j.jss.2006.07.009.
  • Cristescu, M. P., Stoica, E. A., Ciovică, L. V. (2015). The comparison of software reliability assessment models. Procedia Economics and Finance, 27, 669-675. https://doi.org/10.1016/S2212-5671(15)01047-3.
  • Cusick, J. J. (2019). The first 50 years of software reliability engineering: A history of SRE with first person accounts. arXiv preprint arXiv:1902.06140.
  • Daniels, D., Myers, R., & Hilton, A. (2003). White box software development. In Current Issues in Safety-Critical Systems: Proceedings of the Eleventh Safety-critical Systems Symposium, Bristol, UK, 4–6 February 2003, 119-136. London: Springer London. https://doi.org/10.1007/978-1-4471-0653-1_7.
  • Febrero, F., Calero, C., & Moraga, M. Á. (2016). Software reliability modeling based on ISO/IEC SQuaRE. Information and Software Technology, 70, 18-29., https://doi.org/10.1016/j.infsof.2015.09.006.
  • Ferreira, F. H. C., Nakagawa, E. Y., dos Santos, R. P. (2023). Towards an understanding of reliability of software-intensive systems-of-systems. Information and Software Technology, 158, 107186.
  • Ghodrati, B., Hadi Hoseinie, S., Garmabaki, A. H. S. (2015). Reliability considerations in automated mining systems. International journal of mining, reclamation and environment, 29(5), 404-418.
  • Gokhale, S. S. (2007). Architecture-based software reliability analysis: Overview and limitations. IEEE Transactions on dependable and secure computing, 4(1), 32-40.
  • Gordieiev, O., Kharchenko, V., Fominykh, N., Sklyar, V. (2014). Evolution of software quality models in context of the standard ISO 25010. In Proceedings of the Ninth International Conference on Dependability and Complex Systems DepCoS-RELCOMEX. June 30–July 4, 2014, Brunów, Poland, pp. 223-232. Springer International Publishing. https://doi.org/10.1007/978-3-319-07013-1_21
  • IEEE  610.12-1990 Standard Glossary of Software Engineering Terminology. https://ieeexplore.ieee.org/document/159342
  • IEEE 730-2014 Standard for Software Quality Assurance Processes. https://ieeexplore.ieee.org/document/6835311
  • IEEE 1061-1992 Standard for a Software Quality Metrics Methodology. https://ieeexplore.ieee.org/document/237006. 
  • In use qualities from ISO/IEC 25010. 3-4. https://www.irit.fr/recherches/ICS/projects/twintide/upload/435.pdf
  • ISO 9001 and related standards. https://www.iso.org/iso-9001-quality-management.html
  • ISO/IEC 25010:2011 Systems and software engineering — Systems and software Quality Requirements and Evaluation (SQuaRE) — System and software quality models. https://www.iso.org/obp/ui/#iso:std:iso-iec:25010:ed-1:v1:en
  • ISO/IEC 9126-1:2001 Software engineering — Product quality — Part 1: Quality model. https://www.standards.ru/document/3617603.aspx
  • Jalilian, S., & Mahmudova, S. J. (2022). Automatic generation of test cases for error detection using the extended Imperialist Competitive Algorithm. Problems of Information Society, 46-54.
  • Jatain, A., & Mehta, Y. (2014). Metrics and models for software reliability: A systematic review. In 2014 International Conference on Issues and Challenges in Intelligent Computing Techniques (ICICT),   210-214. IEEE.  doi: 10.1109/ICICICT.2014.6781281.
  • Jharko, E. (2021). Ensuring the software quality for critical infrastructure objects. IFAC-PapersOnLine, 54(13), 499-504. https://doi.org/10.1016/j.ifacol.2021.10.498
  • Kazimov, T. H., Bayramova, T. A., & Malikova, N. J. (2021). Research of intelligent methods of software testing. System Research & Information Technologies, 4,  42-52.
  • Kumar, A., & Gupta, D. (2017). Paradigm shift from conventional software quality models to web based quality models. International Journal of Hybrid Intelligent Systems, 14(3), 167-179.
  • Lee, D. H., Chang, I. H., & Pham, H. (2022). Software reliability growth model with dependent failures and uncertain operating environments. Applied Sciences, 12(23), 12383.
  • Maevsky, D., Kharchenko, V., Kolisnyk, M., & Maevskaya, E. (2017, September). Software reliability models and assessment techniques review: Classification issues. In 2017 9th IEEE International Conference on Intelligent Data Acquisition and Advanced Computing Systems: Technology and Applications, 2, 894-899.
    doi: 10.1109/IDAACS.2017.8095216.
  • McCall, J., Paul, K., Richards and F. Walters (1977). Factors in software quality: concept and definitions of software quality / Final Technical Report General Electric Company, 1, 25-31, 168.
  • McConnell, S. (2004). Code complete. Pearson Education. 952.
  • Mengmeng Z., Xuemei Z., Hoang P. (2015). A comparison analysis of environmental factors affecting software reliability, Journal of Systems and Software, 109, 150-160, https://doi.org/10.1016/j.jss.2015.04.083.
  • Miguel, J. P., Mauricio, D., Rodríguez, G. (2014). A review of software quality models for the evaluation of software products. arXiv preprint arXiv:1412.2977.
  • Musa, J. D., & Everett, W. W. (1990). Software-reliability engineering: Technology for the 1990s. IEEE Software, 7(6), 36-43.
  • Nagar, P., & Thankachan, B. (2012). Application of Goel-Okumoto model in software reliability measurement. Int. J. Comp. Appl. Special Issue ICNICT, 5, 1-3.
  • Nayyar, A. (2019). Instant approach to software testing: Principles, applications, techniques, and practices. BPB Publications, India, 2019, 99-101, 368.
  • Ndukwe, I. G., Licorish, S. A., Tahir, A., MacDonell, S. G. (2023). How have views on software quality differed over time? Research and practice viewpoints. Journal of Systems and Software, 195, 111524.
  • Ozcan, A., Çatal, Ç., Togay, C., Tekinerdogan, B., Donmez, E. (2020). Assessment of environmental factors affecting software reliability: A survey study. Turkish Journal of Electrical Engineering and Computer Sciences, 28(4), 1841-1858.
  • Rashid, J., Mahmood, T., Nisar, M. W. (2019). A study on software metrics and its impact on software quality.  Technical Journal, University of Engineering and Technology (UET) Taxila, Pakistan 24(1), 1-14.
  • Sahu, K., & Srivastava, R.K. (2019). Revisiting software reliability. Data Management, Analytics and Innovation: Proceedings of ICDMAI 2018, 1, 221-235.
  • Sahu, K., & Srivastava, R. K. (2020). Needs and importance of reliability prediction: An industrial perspective. Information Sciences Letters, 9(1), 33-37. https://digitalcommons.aaru.edu.jo/isl/vol9/iss1/5
  • Smidts, C., Stutzke, M., Stoddard, R. W. (1998). Software reliability modeling: an approach to early reliability prediction. IEEE Transactions on Reliability, 47(3), 268-278. doi: 10.1109/24.740500.
  • Standard Glossary of Software Engineering Terminology, STD-729-1991, ANSI/IEEE, 1991
  • The cost of poor software quality in the us: a 2022 report. (2023). https://www.it-cisq.org/the-cost-of-poor-quality-software-in-the-us-a-2022-report/
  • Van Driel, W. D., Bikker, J. W., Tijink, M. (2021). Prediction of software reliability. Microelectronics Reliability, 119, 114074.
  • Van Driel, W. D., Schuld, M., Wijgers, R., Van Kooten, W. E. J. (2014). Software reliability and its interaction with hardware reliability. In 2014 15th International Conference on Thermal, Mechanical and Mulit-Physics Simulation and Experiments in Microelectronics and Microsystems (EuroSimE) Ghent, Belgium, 1-8. IEEE.
     doi: 10.1109/EuroSimE.2014.6813774
  • Yadav, H. B., & Yadav, D. K. (2017). Early software reliability analysis using reliability relevant software metrics. International Journal of System Assurance Engineering and Management, 8, 2097-2108. https://doi.org/10.1007/s13198-014-0325-3
  • Yang, L., Zhang, H., Shen, H., Huang, X., Zhou, X., Rong, G., Shao, D. (2021). Quality assessment in systematic literature reviews: A software engineering perspective. Information and Software Technology, 130, 106397. https://doi.org/10.1016/j.infsof.2020.106397
  • Zhang, X., & Pham, H. (2000). An analysis of factors affecting software reliability. Journal of Systems and Software, 50(1), 43-56.
  • Zhang, X., Shin, M. Y., Pham, H. (2001). Exploratory analysis of environmental factors for enhancing the software reliability assessment. Journal of Systems and Software, 57(1), 73-78.