Quality and Reliability Metrics for IoT Systems: A Consolidated View
This paper addresses the lack of a consolidated view on quality and reliability metrics for IoT systems, which is a problem for developers and testers in the IoT domain.
This study consolidates available quality and reliability metrics for Internet of Things (IoT) systems, categorizing them into metrics for system/service quality, testing process effectiveness, and universally applicable metrics. It aims to provide a comprehensive view specific to IoT, which was previously lacking.
Quality and reliability metrics play an important role in the evaluation of the state of a system during the development and testing phases, and serve as tools to optimize the testing process or to define the exit or acceptance criteria of the system. This study provides a consolidated view on the available quality and reliability metrics applicable to Internet of Things (IoT) systems, as no comprehensive study has provided such a view specific to these systems. The quality and reliability metrics categorized and discussed in this paper are divided into three categories: metrics assessing the quality of an IoT system or service, metrics for assessing the effectiveness of the testing process, and metrics that can be universally applied in both cases. In the discussion, recommendations of proper usage of discussed metrics in a testing process are then given.