An Adaptive Approach to Optimize Probabilistic Distributed Testing
Abstract
Typically, conformance testing consists of placing a set of parallel testers at each port of an implementation to ensure its conformance to the specifification. However, a number of common fault detections occur if no coordination is made between these parallel testers and the implementation under test (IUT). Therefore, the test process must support mechanisms of coordination between these distributed components, particularly for implementation with stochastic behaviour. To this end, as well as to analyse the stochastic behaviour of the implementation under test, we propose in this paper an algorithm to generate for each tester a probabilistic local test sequence (PLTS) aiming to avoid both synchronization and observation issues. Finally, we suggest a new architecture based on Markov decision processes with an adaptive controller to control and optimize the whole testing process.References
K. C. Tai, and Y. C. Young, Synchronizable test sequences of finite state machines, Computer Networks, vol. 30, pp. 1111–1134, 1998.
R. M. Hierons, Testing a distributed system: generating minimal synchronised test sequences that detect output-shifting faults, Information and Software Technology, vol. 43, no. 9, pp. 551–560, 2001.
H. Ural, and D. Whittier, Distributed testing without encountering controllability and observability problems, Information Processing Letters, vol. 88, pp. 133-141, 2003.
O. Rafiq, and L. Cacciari, Coordination algorithm for distributed testing, The Journal of Supercomputing, vol. 24, pp. 203-211, 2003.
S. Azzouzi, M. Benattou, and M. E. H. Charaf, A temporal agent-based approach for testing open distributed systems Computer Standards & Interfaces, vol. 40, pp. 23– 33, 2015.
A. Khoumsi, A new method for testing real time systems Proceedings Seventh International Conference on Real-Time Computing Systems and Applications, pp. 441-450, 2000.
R. M. Hierons, and M. N´u˜nez, Implementation relations and probabilistic schedulers in the distributed test architecture, Journal of Systems and Software, vol. 132, pp. 319–335, 2017.
G. Luo, R. Dssouli, G. v Bochmann, P. Venkataram, and A. Ghedamsi, Test generation with respect to distributed interfaces, Computer Standards & Interfaces, vol. 16, no. 2, pp. 119–132, 1994.
J. Chen, R. M. Hierons, and K. Ural, Conditions for resolving observability problems in distributed testing, Lecture Notes Computer Science (including Subseries Lecture Notes Artificial Intelligence Lecture Notes Bioinformatics), vol. 3235, pp. 229–242, 2004.
W. Y. Liu, H. W. Zeng, and H. K. Miao, Multiple UIO-based test sequence generation for distributed systems, Journal of Shanghai University, vol. 12, no. 5, pp. 438–443, 2008.
M. Gerhold, A. Hartmanns, and M. Stoelinga, Model-based testing of stochastically timed systems, Innovations in Systems and Software Engineering, vol. 15, no. 3-4, pp. 207–233, 2019.
F.-Z. Moutai, S. Hsaini, S. Azzouzi, and M. E. H. Charaf, Testing Distributed Cloud: A Case Study, 2019 International Symposium on Advanced Electrical and Communication Technologies (ISAECT), pp. 1–5, 2019.
F.-Z. Moutai, S. Hsaini, S. Azzouzi, and M. E. H. Charaf, Security Testing Approach for IaaS Infrastructure, Proceedings of the 2nd International Conference on Networking, Information Systems & Security (NISS19), pp. 1–5, 2019.
K. G. Larsen, and A. Skou, Bisimulation through Probabilistic Testing (Preliminary Report), in Proceedings of the 16th ACM SIGPLAN-SIGACT Symposium on Principles of Programming Languages, (New York, NY, USA), pp. 344–352, Association for Computing Machinery, 1989.
L. Cheung, M. Stoelinga, and F. Vaandrager, A testing scenario for probabilistic processes, Journal of the ACM, vol. 54, no. 6, pp. 29–29, 2007.
R. M. Hierons, and M. G. Merayo, Mutation testing from probabilistic and stochastic finite state machines, Journal of Systems and Software, vol. 82, no. 11, pp. 1804– 1818, 2009.
H. Bohnenkamp, and A. Belinfante, Timed testing with TorX, Lecture Notes Computer Science, vol. 3582, pp. 173–188, 2005.
G. H. Walton, J. H. Poore, and C. J. Trammell, Statistical testing of software based on a usage model, Software: Practice and Experience, vol. 25, no. 1, pp. 97–108, 1995.
J. A. Whittaker, K. Rekab, and M. G. Thomason, A Markov chain model for predicting the reliability of multi-build software, Information and Software Technology, vol. 42, no. 12, pp. 889–894, 2000.
S. J. Prowell, Computations for Markov Chain Usage Models, Computer Science Technical Report UT-CS-03- 505, pp. 03-505, 2003.
M. Gerhold, and M. Stoelinga, Model-based testing of probabilistic systems, Formal Aspects of Computing, vol. 30, no. 1, pp. 77–106, 2018.
M. E. H. Charaf, M. Benattou, and A. S. A. Jess, AGENT based architecture for testing distributed systems, Journal of Information Science and Engineering, vol. 30, no. 5, pp. 1619–1634, 2014.
S. Hsaini, S. Azzouzi, and M. E. H. Charaf, Testing Rules for Mapreduce Fameworks, Colloquium in Information Science and Technology, 2018.
S. Azzouzi, S. Hsaini, and M. E. H. Charaf, A Synchronized Test Control Execution Model of Distributed Systems, International Journal of Grid and High Performance Computing, vol. 12, no. 1, pp. 1–17, 2020.
M. E. H. Charaf, and S. Azzouzi, A colored petri-net model for control execution of distributed systems, 4th International Conference on Control Decision and Information Technologies (CoDIT’17), pp. 277–282, 2017.
M. A. Tajioue, O. Maakoul, S. Hsaini, S. Azzouzi, and M. E. H. Charaf, Towards Overcoming Issues of Testing Probabilistic Distributed systems, 2020 7th International Conference on Control Decision and Information Technologies (CoDIT’20), vol. 1, pp. 903–907, 2021.
O. Maakoul, M. A. Tajioue, S. Hsaini, S. Azzouzi, and M. E. H. Charaf, Testing Access Control List Policies in a Hadoop
Environment, 2020 7th International Conference on Control Decision and Information Technologies (CoDIT’20), vol. 1, pp. 831–836, 2021.
R. Bellman, Dynamic Programming and Lagrange Multipliers, Proceedings of the National Academy of Sciences, vol. 42, no. 10, pp. 767–769, 1956.
- Authors retain copyright and grant the journal right of first publication with the work simultaneously licensed under a Creative Commons Attribution License that allows others to share the work with an acknowledgement of the work's authorship and initial publication in this journal.
- Authors are able to enter into separate, additional contractual arrangements for the non-exclusive distribution of the journal's published version of the work (e.g., post it to an institutional repository or publish it in a book), with an acknowledgement of its initial publication in this journal.
- Authors are permitted and encouraged to post their work online (e.g., in institutional repositories or on their website) prior to and during the submission process, as it can lead to productive exchanges, as well as earlier and greater citation of published work (See The Effect of Open Access).
