2.7CEJul 6
Markov Decision Process Approximation Methods for Water Distribution Network Inspection and Maintenance: A Case Study of the U.S. Virgin IslandsMinsuk Seo, Daniel A. Eisenberg, Jefferson Huang
We develop a repair-oriented inspection and maintenance decision framework for water distribution networks. This work is motivated by utilities operating in data-sparse environments, such as in remote locations like the U.S. Virgin Islands, where data collection about network state and underground pipeline outages is limited to above-ground and easy to access information (e.g., water tank levels and pump operations). We formulate the problem as a discounted Markov decision process and integrate it with high-fidelity hydraulic simulation. The model captures latent system dynamics without requiring pipe-level sensing. The results reveal state-dependent optimal policies and heterogeneous failure characteristics across pipes, including rare but high-impact behaviors. We further show that certain observable system states uniquely correspond to specific pipe failures, enabling a form of virtual sensing. These findings demonstrate that system-level dynamics can support inspection planning and maintenance decisions under uncertainty in resource-constrained settings.
6.4LGFeb 1, 2024
Tropical Decision Boundaries for Neural Networks Are Robust Against Adversarial AttacksKurt Pasque, Christopher Teska, Ruriko Yoshida et al.
We introduce a simple, easy to implement, and computationally efficient tropical convolutional neural network architecture that is robust against adversarial attacks. We exploit the tropical nature of piece-wise linear neural networks by embedding the data in the tropical projective torus in a single hidden layer which can be added to any model. We study the geometry of its decision boundary theoretically and show its robustness against adversarial attacks on image datasets using computational experiments.
13.3AIDec 19, 2013
The Value Iteration Algorithm is Not Strongly Polynomial for Discounted Dynamic ProgrammingEugene A. Feinberg, Jefferson Huang
This note provides a simple example demonstrating that, if exact computations are allowed, the number of iterations required for the value iteration algorithm to find an optimal policy for discounted dynamic programming problems may grow arbitrarily quickly with the size of the problem. In particular, the number of iterations can be exponential in the number of actions. Thus, unlike policy iterations, the value iteration algorithm is not strongly polynomial for discounted dynamic programming.