An explainable Recursive Feature Elimination to detect Advanced Persistent Threats using Random Forest classifier
This addresses the problem of improving intrusion detection systems for cybersecurity practitioners, but it is incremental as it combines existing methods.
The paper tackled detecting Advanced Persistent Threats in cybersecurity by integrating Recursive Feature Elimination with Random Forest and SHAP for explainability, achieving 99.9% detection accuracy and reduced false positives and computational costs.
Intrusion Detection Systems (IDS) play a vital role in modern cybersecurity frameworks by providing a primary defense mechanism against sophisticated threat actors. In this paper, we propose an explainable intrusion detection framework that integrates Recursive Feature Elimination (RFE) with Random Forest (RF) to enhance detection of Advanced Persistent Threats (APTs). By using CICIDS2017 dataset, the approach begins with comprehensive data preprocessing and narrows down the most significant features via RFE. A Random Forest (RF) model was trained on the refined feature set, with SHapley Additive exPlanations (SHAP) used to interpret the contribution of each selected feature. Our experiment demonstrates that the explainable RF-RFE achieved a detection accuracy of 99.9%, reducing false positive and computational cost in comparison to traditional classifiers. The findings underscore the effectiveness of integrating explainable AI and feature selection to develop a robust, transparent, and deployable IDS solution.