Design and Implementation of a Prototype Open Benchmarking Platform for Collective Adaptive Systems

In every domain of scientific research, the comparison between innovative solutions and the state of the art is crucial. This practice enables the evaluation of whether the system under examination outperforms the established reference, either comprehensively or in specific aspects. In various fields of computer science, tools have been developed to benchmark new and existing solutions. On the other hand, in the domain of collective adaptive systems, a conspicuous gap exists in software designed to facilitate such comparisons. The primary objective of this thesis is to create a prototype for a benchmarking platform focused on Collective Adaptive Systems (CAS). By making use of existing simulators available in the market, the aim is to establish a comprehensive framework for testing, validating, and comparing these dynamic systems. The presented platform is designed to allow users to define benchmarks, execute them, and extract results of interest - all while preserving flexibility and extensibility. This inherent adaptability allows for the incorporation of additional simulators into the testbed. An experiment has been executed to validate the framework's anticipated functionalities and understand its strengths and weaknesses. This analysis serves the purpose of identifying areas for future improvement within the tool.