Constrained Training of Neural Networks via Theorem Proving
This provides a safer and more reliable way to incorporate logical constraints into neural network training, addressing risks in ad-hoc implementations for domains like dynamic movement.
The paper tackles the problem of specifying and generating temporal logical constraints for training neural networks by introducing a theorem proving approach, resulting in a fully rigorous method that produces expected results for common movement specification patterns like obstacle avoidance and patrolling.
We introduce a theorem proving approach to the specification and generation of temporal logical constraints for training neural networks. We formalise a deep embedding of linear temporal logic over finite traces (LTL$_f$) and an associated evaluation function characterising its semantics within the higher-order logic of the Isabelle theorem prover. We then proceed to formalise a loss function $\mathcal{L}$ that we formally prove to be sound, and differentiable to a function $d\mathcal{L}$. We subsequently use Isabelle's automatic code generation mechanism to produce OCaml versions of LTL$_f$, $\mathcal{L}$ and $d\mathcal{L}$ that we integrate with PyTorch via OCaml bindings for Python. We show that, when used for training in an existing deep learning framework for dynamic movement, our approach produces expected results for common movement specification patterns such as obstacle avoidance and patrolling. The distinctive benefit of our approach is the fully rigorous method for constrained training, eliminating many of the risks inherent to ad-hoc implementations of logical aspects directly in an "unsafe" programming language such as Python.