Robust Artificial Intelligence and Robust Human Organizations
It tackles the problem of ensuring safety in high-risk AI deployments for organizations and society, but is incremental as it reviews existing concepts without introducing new methods or data.
The paper addresses the need for AI systems deployed by human organizations to function as high-reliability organizations to prevent catastrophic errors in high-risk applications, reviewing properties of such organizations and deriving implications for AI development and safe application.
Every AI system is deployed by a human organization. In high risk applications, the combined human plus AI system must function as a high-reliability organization in order to avoid catastrophic errors. This short note reviews the properties of high-reliability organizations and draws implications for the development of AI technology and the safe application of that technology.