Evolution of quality assessment in SPL: a systematic mapping

Abstract

Software product line (SPL) is one of the most recent and effective reuse approaches. SPL derives several products from the core artefacts. SPL engineering includes two processes: domain engineering, which identifies the common and variable features to develop the core artefacts, and application engineering, which reuses the core artefacts to derive products. Once the artefacts are reused across multiple products, quality assessment is necessary to prevent inconsistencies from spreading across all SPL products. There are several frameworks and standards, as ISO/IEC 25010:2011, to evaluate quality characteristics. In this study, the authors provide an overview of the SPL quality assessment. Therefore, they perform a systematic mapping to compile and synthesise data regarding the quality characteristics assessed in studies from 2000 to 2019. The results include the identification of 346 metrics applied in 16 software properties to evaluate three quality characteristics of the ISO/IEC 25010:2011. Additionally, they find the domain engineering evaluation frequently occurs regarding the maintainability characteristic. Moreover, they provide analyses of the: (i) metrics used by programming paradigm, (ii) metrics used by software properties, (iii) software properties evaluated for each quality characteristic, (iv) tools used to extract metrics, (v) systems used as benchmarks, and (vi) datasets used for extracting metrics.