AgentDSM-Eval: A framework for the evaluation of domain-specific modeling languages for multi-agent systems

dc.contributor.authorAlaca, Omer Faruk
dc.contributor.authorTezel, Baris Tekin
dc.contributor.authorChallenger, Moharram
dc.contributor.authorGoulao, Miguel
dc.contributor.authorAmaral, Vasco
dc.contributor.authorKardas, Geylani
dc.date.accessioned2021-05-03T20:19:02Z
dc.date.available2021-05-03T20:19:02Z
dc.date.issued2021
dc.departmentEge Üniversitesien_US
dc.description.abstractSoftware development required for constructing multi-agent systems (MAS) usually becomes challenging and time-consuming due to the properties of autonomy, distributedness, and openness of these systems in addition to the complicated nature of internal agent behaviors and agent interactions. To facilitate MAS development, the researchers propose various domain-specific modeling languages (DSMLs) by enriching MAS metamodels with a defined syntax and semantics. Although the descriptions of these languages are given in the related studies with the examples of their use, unfortunately, many are not evaluated in terms of either the usability (being hard to learn, understand and use) or the quality of the generated artifacts. Hence, in this paper, we introduce an evaluation framework, called AgentDSM-Eval, with its supporting tool which can be used to evaluate MAS DSMLs systematically according to various quantitative and qualitative aspects of agent software development. The empirical evaluation, presented by the AgentDSM-Eval framework, was successfully applied for one of the well-known MAS DSMLs. The assessment showed that both MAS domain coverage of DSMLs and the agent developers? adoption of modeling elements can be determined with this framework. Moreover, the tool?s quantitative results can assess MAS DSML?s performance on the development time and throughput. AgentDSMEval also enables the qualitative assessment of MAS DSML features according to novel quality characteristics and measures, which it defines specifically for the MAS domain.en_US
dc.description.sponsorshipScientific and Technological Research Council of Turkey (TUBITAK)Turkiye Bilimsel ve Teknolojik Arastirma Kurumu (TUBITAK) [115E591]; Portuguese Foundation for Science and Technology (FCT) (Germany) [FCT/MCTES TUBITAK/0008/2014, FCT/MCTES PEst UID/CEC/04516/2013, FCT/DAAD 2018/2019]; NOVA LINCS [UIDB/04516/2020]en_US
dc.description.sponsorshipThis study was funded as a bilateral project by the Scientific and Technological Research Council of Turkey (TUBITAK) under grant 115E591 and the Portuguese Foundation for Science and Technology (FCT) under grants FCT/MCTES TUBITAK/0008/2014 and FCT/MCTES PEst UID/CEC/04516/2013 and FCT/DAAD 2018/2019 (Germany) and NOVA LINCS (UIDB/04516/2020) .en_US
dc.identifier.doi10.1016/j.csi.2021.103513
dc.identifier.issn0920-5489
dc.identifier.issn1872-7018
dc.identifier.issn0920-5489en_US
dc.identifier.issn1872-7018en_US
dc.identifier.scopus2-s2.0-85100216898en_US
dc.identifier.scopusqualityN/Aen_US
dc.identifier.urihttps://doi.org/10.1016/j.csi.2021.103513
dc.identifier.urihttps://hdl.handle.net/11454/69311
dc.identifier.volume76en_US
dc.identifier.wosWOS:000633391200002en_US
dc.identifier.wosqualityQ1en_US
dc.indekslendigikaynakWeb of Scienceen_US
dc.indekslendigikaynakScopusen_US
dc.language.isoenen_US
dc.publisherElsevieren_US
dc.relation.ispartofComputer Standards & Interfacesen_US
dc.relation.publicationcategoryMakale - Uluslararası Hakemli Dergi - Kurum Öğretim Elemanıen_US
dc.rightsinfo:eu-repo/semantics/closedAccessen_US
dc.subjectMulti-agent systemen_US
dc.subjectDomain-specific modeling languageen_US
dc.subjectAgent-oriented software engineeringen_US
dc.subjectEvaluation frameworken_US
dc.subjectHuman factors in Modellingen_US
dc.subjectUsability evaluationen_US
dc.subjectAgentDSM-Evalen_US
dc.titleAgentDSM-Eval: A framework for the evaluation of domain-specific modeling languages for multi-agent systemsen_US
dc.typeArticleen_US

Dosyalar