Correct and Control Complex IoT Systems: Evaluation of a Classification for System Anomalies
This work addresses communication issues for teams operating complex IoT systems, but it is incremental as it extends an existing standard to a new domain.
The paper tackled the problem of imprecise interteam communication about system anomalies in complex IoT systems by evaluating an adapted classification based on IEEE Std. 1044-2009, which was effectively applied in a postmortem analysis at Robert Bosch GmbH to enhance communication and learning.
In practice there are deficiencies in precise interteam communications about system anomalies to perform troubleshooting and postmortem analysis along different teams operating complex IoT systems. We evaluate the quality in use of an adaptation of IEEE Std. 1044-2009 with the objective to differentiate the handling of fault detection and fault reaction from handling of defect and its options for defect correction. We extended the scope of IEEE Std. 1044-2009 from anomalies related to software only to anomalies related to complex IoT systems. To evaluate the quality in use of our classification a study was conducted at Robert Bosch GmbH. We applied our adaptation to a postmortem analysis of an IoT solution and evaluated the quality in use by conducting interviews with three stakeholders. Our adaptation was effectively applied and interteam communications as well as iterative and inductive learning for product improvement were enhanced. Further training and practice are required.