Robust Speech-Workload Estimation for Intelligent Human-Robot Systems
This addresses the need for intelligent modulation in demanding task environments to improve operator performance, though it is incremental by focusing on a specific workload component not widely estimated in real-time.
The paper tackles the problem of real-time speech workload estimation for adaptive human-robot systems, presenting an algorithm that achieves accurate and generalizable results across individuals and teaming paradigms.
Demanding task environments (e.g., supervising a remotely piloted aircraft) require performing tasks quickly and accurately; however, periods of low and high operator workload can decrease task performance. Intelligent modulation of the system's demands and interaction modality in response to changes in operator workload state may increase performance by avoiding undesirable workload states. This system requires real-time estimation of each workload component (i.e., cognitive, physical, visual, speech, and auditory) to adapt the correct modality. Existing workload systems estimate multiple workload components post-hoc, but few estimate speech workload, or function in real-time. An algorithm to estimate speech workload and mitigate undesirable workload states in real-time is presented. An analysis of the algorithm's accuracy is presented, along with the results demonstrating the algorithm's generalizability across individuals and human-machine teaming paradigms. Real-time speech workload estimation is a crucial element towards developing adaptive human-machine systems.