Model Risk Management for Generative AI In Financial Institutions
It tackles the problem of safely integrating Generative AI into highly regulated financial environments, focusing on incremental improvements to existing risk frameworks.
This paper addresses the model risks, such as hallucinations and toxicity, introduced by Generative AI in financial institutions, and proposes enhanced model risk management practices, particularly in model validation, to ensure safe deployment.
The success of OpenAI's ChatGPT in 2023 has spurred financial enterprises into exploring Generative AI applications to reduce costs or drive revenue within different lines of businesses in the Financial Industry. While these applications offer strong potential for efficiencies, they introduce new model risks, primarily hallucinations and toxicity. As highly regulated entities, financial enterprises (primarily large US banks) are obligated to enhance their model risk framework with additional testing and controls to ensure safe deployment of such applications. This paper outlines the key aspects for model risk management of generative AI model with a special emphasis on additional practices required in model validation.