Towards Responsible AI for Financial Transactions
This work addresses the need for explainability in AI systems for financial transactions, which is crucial for building trust, but it is incremental as it applies existing explanation methods to a specific domain.
The study tackled the problem of explaining a deep neural network for financial transaction classification by using SHAP for feature importance and a hybrid text clustering and decision tree approach, and tested model robustness with a targeted evasion attack.
The application of AI in finance is increasingly dependent on the principles of responsible AI. These principles - explainability, fairness, privacy, accountability, transparency and soundness form the basis for trust in future AI systems. In this study, we address the first principle by providing an explanation for a deep neural network that is trained on a mixture of numerical, categorical and textual inputs for financial transaction classification. The explanation is achieved through (1) a feature importance analysis using Shapley additive explanations (SHAP) and (2) a hybrid approach of text clustering and decision tree classifiers. We then test the robustness of the model by exposing it to a targeted evasion attack, leveraging the knowledge we gained about the model through the extracted explanation.