Gowtham Muniraju

Gowtham Muniraju, Cihan Tepedelenlioglu, Andreas Spanias

A novel distributed algorithm for estimating the maximum of the node initial state values in a network, in the presence of additive communication noise is proposed. Conventionally, the maximum is estimated locally at each node by updating the node state value with the largest received measurements in every iteration. However, due to the additive channel noise, the estimate of the maximum at each node drifts at each iteration and this results in nodes diverging from the true max value. Max-plus algebra is used as a tool to study this ergodic process. The subadditive ergodic theorem is invoked to establish a constant growth rate for the state values due to noise, which is studied by analyzing the max-plus Lyapunov exponent of the product of noise matrices in a max-plus semiring. The growth rate of the state values is upper bounded by a constant which depends on the spectral radius of the network and the noise variance. Upper and lower bounds are derived for both fixed and random graphs. Finally, a two-run algorithm robust to additive noise in the network is proposed and its variance is analyzed using concentration inequalities. Simulation results supporting the theory are also presented.

Gowtham Muniraju, Bhavya Kailkhura, Jayaraman J. Thiagarajan et al.

Sampling one or more effective solutions from large search spaces is a recurring idea in machine learning, and sequential optimization has become a popular solution. Typical examples include data summarization, sample mining for predictive modeling and hyper-parameter optimization. Existing solutions attempt to adaptively trade-off between global exploration and local exploitation, wherein the initial exploratory sample is critical to their success. While discrepancy-based samples have become the de facto approach for exploration, results from computer graphics suggest that coverage-based designs, e.g. Poisson disk sampling, can be a superior alternative. In order to successfully adopt coverage-based sample designs to ML applications, which were originally developed for 2-d image analysis, we propose fundamental advances by constructing a parameterized family of designs with provably improved coverage characteristics, and by developing algorithms for effective sample synthesis. Using experiments in sample mining and hyper-parameter optimization for supervised learning, we show that our approach consistently outperforms existing exploratory sampling methods in both blind exploration, and sequential search with Bayesian optimization.