A Hybrid Harmony Search and Particle Swarm Optimization Algorithm (HSPSO) for Testing Non-functional Properties in Software System
Abstract
An important aspect of improving software system is testing. However, it is time demanding and sometimeslabour intensive if done manually. In this paper, we developed an automatic search-based approach for testing the nonfunctional properties of a software system using hybrid harmony search and particle swarm optimization algorithms. The approach birthed a new algorithm named HSPSO, which is proposed based on the strength of HS over Genetic algorithm (GA) in terms of less adjustable parameters, quick convergence and smooth implementation. On the other hand, we propose the PSO to complement the drawback of HS in terms of time consumption problem. Besides, we used four programs for the comparative efficiency analysis of the proposed algorithm in relation to competing algorithms based on average branch coverage and execution time. The results from the analysis showed that the HSPSO algorithm was able to achieve 100% average coverage with a fewer number of generated test cases and under limited execution time.References
J. Kempka, P. McMinn, and D. Sudholt, Design and analysis of different alternating variable searches for search-based software testing, Theor. Comput. Sci., 2015.
C. Sharma, S. Sabharwal, and R. Sibal, A Survey on Software Testing Techniques using Genetic Algorithm, Nov. 2014.
D. R. Kuhn, D. R. Wallace, and A. M. Gallo, Software fault interactions and implications for software testing, IEEE Trans. Softw. Eng., 2004.
P. Zech, P. Kalb, M. Felderer, C. Atkinson, and R. Breu, Model-based regression testing by OCL, Int. J. Softw. Tools Technol. Transf., vol. 19, no. 1, pp. 115–131, 2017.
J. Meinicke, T. Th¨um, R. Schr¨oter, F. Benduhn, and G. Saake, An overview on analysis tools for software product lines, in ACM International Conference Proceeding Series, 2014.
L. Chung, B. A. Nixon, E. Yu, and J. Mylopoulos, Non-Functional Requirements in Software Engineering, 2000.
M.Khari and P. Kumar, An extensive evaluation of search-based software testing: a review, Soft Computing, 23(6), 1933–1946.
B. Lindstr¨om, S. M. Ali, and M. Blom, Testability and Software Performance : A Systematic Mapping Study, ACM Symp. Appl. Comput., pp. 1566–1569, 2016.
C. Sharma, S. Sabharwal, R. Sibal, A. Hind, and F. Marg, A Survey on Software Testing Techniques using Genetic Algorithm, 2013.
B. Korel, Automated Software Test Data Generation, IEEE Trans. Softw. Eng., vol. 16, no. 8, pp. 870–879, 1990.
S. Ali, L. C. Briand, H. Hemmati, and R. K. Panesar-Walawege, A systematic review of the application and empirical investigation of search-based test case generation, IEEE Transactions on Software Engineering. 2010.
W. Afzal, R. Torkar, and R. Feldt, A systematic review of search-based testing for non-functional system properties, Information and Software Technology, vol. 51, no. 6. pp. 957–976, 2009.
R. E. Lopez-Herrejon, L. Linsbauer, and A. Egyed, A systematic mapping study of search-based software engineering for software product lines, Information and Software Technology. 2015.
B. Xu, X. Xie, L. Shi, and C. Nie, Application of Genetic Algorithms in Software Testing, Adv. Mach. Learn. Appl. Softw. Eng., pp. 287–317, 2011.
M. A. Jamil, M. Arif, N. S. A. Abubakar, and A. Ahmad, Software testing techniques: A literature review, in Proceedings - 6th International Conference on Information and Communication Technology for the Muslim World, ICT4M 2016, 2017.
S. Varshney and M. Mehrotra, Search based software test data generation for structural testing, ACM SIGSOFT Softw. Eng. Notes, 2013.
M. Utting, A. Pretschner, and B. Legeard, A taxonomy of model-based testing approaches, Softw. Test. Verif. Reliab., vol. 22, no. 5, pp. 297–312, 2012.
A. Aleti and L. Grunske, Test data generation with a Kalman filter-based adaptive genetic algorithm, J. Syst. Softw., vol. 103, pp. 343–352, 2015.
G. Fraser and A. Arcuri, 1600 faults in 100 projects: automatically finding faults while achieving high coverage with EvoSuite, Empir. Softw. Eng., vol. 20, no. 3, pp. 611–639, 2015.
R. Matinnejad, S. Nejati, L. C. Briand, and T. Bruckmann, Effective test suites for mixed discrete-continuous stateflow controllers, in 2015 10th Joint Meeting of the European Software Engineering Conference and the ACM SIGSOFT Symposium on the Foundations of Software Engineering, ESEC/FSE 2015 - Proceedings, 2015.
Z. Qin, G. Denker, C. Giannelli, P. Bellavista, and N. Venkatasubramanian, A software defined networking architecture for the internet-of-things, in IEEE/IFIP NOMS 2014 - IEEE/IFIP Network Operations and Management Symposium: Management in a Software Defined World, 2014.
A. Ramłrez, J. R. Romero, and S. Ventura, An approach for the evolutionary discovery of software architectures, Inf. Sci. (Ny)., vol. 305, pp. 234–255, 2015.
Amarjeet and J. K. Chhabra, Harmony search based remodularization for object-oriented software systems, Comput. Lang. Syst. Struct., 2017.
X. Yao and D. Gong, Genetic algorithm-based test data generation for multiple paths via individual sharing, Comput. Intell. Neurosci., vol. 2014, 2014.
R. K. Sahoo, D. P. Mohapatra, and M. R. Patra, A Firefly Algorithm Based Approach for Automated Generation and Optimization of Test Cases, Int. J. Comput. Sci. Eng., vol. 4, no. 8, pp. 1–6, 2016.
A. Singh, N. Garg, and T. Saini, A hybrid Approach of Genetic Algorithm and Particle Swarm Technique to Software Test Case Generation, Int. J. Innov. Eng. Technol., vol. 3, no. 4, pp. 208–214, 2014.
A. Kiran and G. Radhamani, A Hybrid Model of Particle Swarm Optimization ( PSO ) and Artificial Bee Colony ( ABC ) Algorithm for Test Case Optimization, Int. J. Comput. Sci. Eng.(IJCSE), pp. 266–271, 2011.
O. R. Olaniran and M. A. A. Abdullah, Bayesian Variable Selection for Multiclass Classification using Bootstrap Prior Technique, Austrian Journal of Statistics, vol. 48, no. 2, pp. 63–72, 2019.
O. R. Olaniran and W. B. Yahya, Bayesian hypothesis testing of two normal samples using bootstrap prior technique, Journal of Modern Applied Statistical Methods, vol. 16, no. 2, pp. 618–638, 2017.
O. R. Olaniran and M. A. A. Abdullah, Subset Selection in High-Dimensional Genomic Data using Hybrid Variational Bayes and Bootstrap priors, Journal of Physics: Conference Series, IOP Publishing, vol. 1489, pp. 012030, 2020.
J. Popoola, W. B. Yahya, O. Popoola and O. R. Olaniran, Generalized Self-Similar First Order Autoregressive Generator (GSFOARG) for Internet Traffic, Stat., Optim. Inf. Comput., Vol. 8, pp. 0–11. September, 2020.
C. Mao, Generating Test Data for Software Structural Testing Based on Particle Swarm Optimization, Arab. J. Sci. Eng., 2014.
D. Weyland, A critical analysis of the harmony search algorithm-How not to solve sudoku, Oper. Res. Perspect., 2015.
K. Lakshmi and A. R. M. Rao, Multi-objective optimal design of composite box beam using hybrid adaptive harmony search with dynamically reconfigurable harmony memory, Proc. Inst. Mech. Eng. Part C J. Mech. Eng. Sci., 2019.
J. Shang, Y. Tian, Y. Liu and R. Liu, Production scheduling optimization method based on hybrid particle swarm optimization algorithm, Journal of Intelligent & Fuzzy Systems, Vol. 34 no.2, pp. 955–964, 2018.
T. Lengauer and R. E. Tarjan, A Fast Algorithm for Finding Dominators in a Flowgraph, ACM Trans. Program. Lang. Syst., 1979.
Y. Jia, W. Chen, J. Zhang and J. Li, Generating software test data by particle swarm optimization, Asia-Pacific Conference on Simulated Evolution and Learning. Springer, Cham, 2014.
- Authors retain copyright and grant the journal right of first publication with the work simultaneously licensed under a Creative Commons Attribution License that allows others to share the work with an acknowledgement of the work's authorship and initial publication in this journal.
- Authors are able to enter into separate, additional contractual arrangements for the non-exclusive distribution of the journal's published version of the work (e.g., post it to an institutional repository or publish it in a book), with an acknowledgement of its initial publication in this journal.
- Authors are permitted and encouraged to post their work online (e.g., in institutional repositories or on their website) prior to and during the submission process, as it can lead to productive exchanges, as well as earlier and greater citation of published work (See The Effect of Open Access).
