Operator Responsibility for Outcomes: A Demonstration of the ResQu Model
This addresses the issue of ambiguous responsibility allocation in automated systems for operators and managers, but it is incremental as it builds on prior work by Douer & Meyer.
The paper tackled the problem of quantifying human operator responsibility in automated systems by developing the ResQu model, and found that in a dairy factory fault event, the model calculated zero objective responsibility for the operator, while subjective assessments from managers assigned much higher responsibility.
In systems with advanced automation, human responsibility for outcomes becomes equivocal. We developed the Responsibility Quantification (ResQu) model to compute a measure of operator responsibility (Douer & Meyer, 2020) and compared it to observed and subjective levels of responsibility (Douer & Meyer, 2019). We used the model to calculate operators' objective responsibility in a common fault event in the control room in a dairy factory. We compared the results to the subjective assessments made by different functions in the diary. The capabilities of the automation greatly exceeded those of the human, and the operator should comply with the indications of the automation. Thus, the objective causal human responsibility is 0. Outside observers, such as managers, assigned much higher responsibility to the operator, possibly holding operators responsible for adverse outcomes in situations in which they rightly trusted the automation.