Information Science Principles of Machine Learning: A Causal Chain Meta-Framework Based on Formalized Information Mapping
This work addresses foundational theoretical gaps in machine learning for researchers and practitioners seeking rigorous frameworks for interpretability and safety.
This paper tackles the lack of a unified formal framework in machine learning theory by constructing a formal information model and establishing the Machine Learning Theory Meta-Framework (MLT-MF), which provides universal definitions for model interpretability and ethical safety and proves four key theorems including equivalence between interpretability and information existence.
This paper addresses the current lack of a unified formal framework in machine learning theory, as well as the absence of robust theoretical foundations for interpretability and ethical safety assurance. We first construct a formal information model, employing sets of well-formed formulas (WFFs) to explicitly define the ontological states and carrier mappings for the core components of machine learning. By introducing learnable and processable predicates, as well as learning and processing functions, we analyze the logical inference and constraint rules underlying causal chains in models, thereby establishing the Machine Learning Theory Meta-Framework (MLT-MF). Building upon this framework, we propose universal definitions for model interpretability and ethical safety, and rigorously prove and validate four key theorems: the equivalence between model interpretability and information existence, the constructive formulation of ethical safety assurance and two types of total variation distance (TVD) upper bounds. This work overcomes the limitations of previous fragmented approaches, providing a unified theoretical foundation from an information science perspective to systematically address the critical challenges currently facing machine learning.