Machine Learning-Driven Test Case Prioritization Through Data Analytics in Software Testing

Authors

Keywords:

Software Testing, Test Case Prioritization, Machine Learning Techniques, Unit Test Optimization, Metaheuristic Methods

Abstract

Software testing plays a critical role in maintaining the dependability and overall quality of software applications. Nevertheless, it often demands significant time and computational resources, especially in unit testing environments. With the continuous expansion of test suites, running every available test case is no longer a practical strategy. Test Case Prioritization (TCP) addresses this challenge by arranging test cases in an order that increases the likelihood of detecting faults earlier while minimizing testing effort and cost. Conventional TCP techniques are often limited in their ability to adapt to the fast-paced nature of current software development practices. To overcome these shortcomings, this research explores the application of machine learning (ML) methods within the TCP framework to improve prioritization effectiveness. In contrast to fixed or rule-based techniques, ML-based approaches can learn patterns from historical test data and make adaptive prioritization decisions. For this purpose, a dataset was generated using several metaheuristic methods, including Genetic Algorithm (GA), Particle Swarm Optimization (PSO), Grey Wolf Optimizer (GWO), and a hybrid GWO model, implemented on the triangle classification benchmark problem. The collected test cases were categorized into five classes according to coverage criteria and then prepared for model training. Four supervised ML classifiers were developed and assessed using stratified 10-fold cross-validation. Their performance was evaluated based on widely used metrics, including accuracy, precision, recall, F1-score, and AUC. Experimental findings showed that the proposed approach reached an accuracy of 97.31% and an F1-score of 92.94%, surpassing traditional TCP methods. These findings indicate that integrating ML into TCP can improve early fault discovery, decrease unnecessary test executions, and offer an automated and scalable approach for more effective unit testing.

References

Arasteh, B., Hosseini, S.M.J. (2022). Traxtor: An Automatic Software Test Suit Generation Method Inspired by Imperialist Competitive Optimization Algorithms. Journal of Electronic Testing, 205-215.

Bertolino, A., Guerriero, A., Miranda, B., Pietrantuono, R., & Russo, S. (2020). Learning-to-rank vs ranking-to-learn: Strategies for regression testing in continuous integration. 2020 IEEE/ACM 42nd International Conference on Software Engineering (ICSE), Seoul, Korea (South).

Khambam, S. K. R., Kaluvakuri, V. P. K., & Peta, V. P. (2022). Optimizing Cloud-Based Regression Testing: A Machine Learning-Driven Paradigm for Swift and Effective Releases. Available at SSRN 4927238.

Konidena, B. K., Bairi, A. R., & Pichaimani, T. (2021). Reinforcement Learning-Driven Adaptive Test Case Generation in Agile Development. American Journal of Data Science and Artificial Intelligence Innovations, 1, 241-273.

Lachmann, R. (2018). Machine learning-driven test case prioritization approaches for black-box software testing. The European test and telemetry conference, Nuremberg, Germany,

Lonetti, F., & Marchetti, E. (2018). Emerging Software Testing Technologies. In. Elsevier.

Marijan, D. (2023). Comparative study of machine learning test case prioritization for continuous integration testing. Software Quality Journal.

Muhammad, A. (2024). AI-Driven Testing Automation: Harnessing Machine Learning for Intelligent Test Case Creation and Predictive Defect Analysis. International Journal of Artificial Intelligence and Applications, 9(3), 22-35.

Mukherjee, R., & Patnaik, K. S. (2021). A survey on different approaches for software test case prioritization Journal of King Saud University – Computer and Information Sciences 1041–1054 1040pl.

Pandhare, H. V. (2025). Future of software test automation using ai/ml. International Journal Of Engineering And Computer Science, 13(05).

Ramachandran, S. (2026). Leveraging AI-driven multi-agents for next-generation software testing: a lattice-based cross-industry automation framework. International Journal of Information Technology, 1-8.

Ramzan, H. A., Islam, K., Hussain, M. A., Monim, R. M., Asad, S. M., & Ramzan, S. (2026). Data-Driven Test Case Prioritization (DD-TCP): A Machine Learning Framework for Intelligent Software Quality Assurance. Computers, Materials, & Continua, 88(1).

Sakhrawi, Z., Labidi, T. (2024). Test case selection and prioritization approach for automated regression testing using ontology and COSMIC measurement. Automated Software Engineering.

Sivaraman, H. (2020). Machine learning for software quality and reliability: Transforming software engineering. Libertatem Media Private Limited.

Sugave, S. R., Kulkarni, Y.R., Jagdale, B. et al. (2025). Fault-Aware Test Case Prioritization in Software Testing Using Jaya Archimedes Optimization Algorithm. Journal of Electron Test.

Wang, X., Zhang, S. (2023). Cluster-based adaptive test case prioritization. Information and Software Technology, 107339.

Downloads

Publication Timeline

Published
Submitted
Revised
Accepted

Issue

Section

Articles

How to Cite

Firouzi, A., & Arasteh, B. . (2026). Machine Learning-Driven Test Case Prioritization Through Data Analytics in Software Testing. Decision Science and Intelligent Systems, 3(1), 1-15. https://www.dsisj.com/index.php/dsisj/article/view/98

Similar Articles

1-10 of 27

You may also start an advanced similarity search for this article.