Gabriel Gomes

Hongyuan Zhan, Gabriel Gomes, Xiaoye S. Li et al.

Computational efficiency is an important consideration for deploying machine learning models for time series prediction in an online setting. Machine learning algorithms adjust model parameters automatically based on the data, but often require users to set additional parameters, known as hyperparameters. Hyperparameters can significantly impact prediction accuracy. Traffic measurements, typically collected online by sensors, are serially correlated. Moreover, the data distribution may change gradually. A typical adaptation strategy is periodically re-tuning the model hyperparameters, at the cost of computational burden. In this work, we present an efficient and principled online hyperparameter optimization algorithm for Kernel Ridge regression applied to traffic prediction problems. In tests with real traffic measurement data, our approach requires as little as one-seventh of the computation time of other tuning methods, while achieving better or similar prediction accuracy.

Matthew A. Wright, Gabriel Gomes, Roberto Horowitz et al.

Macroscopic traffic models are necessary for simulation and study of traffic's complex macro-scale dynamics, and are often used by practitioners for road network planning, integrated corridor management, and other applications. These models have two parts: a link model, which describes traffic flow behavior on individual roads, and a node model, which describes behavior at road junctions. As the road networks under study become larger and more complex --- nowadays often including arterial networks --- the node model becomes more important. This paper focuses on the first order node model and has two main contributions. First, we formalize the multi-commodity flow distribution at a junction as an optimization problem with all the necessary constraints. Most interesting here is the formalization of input flow priorities. Then, we discuss a very common "conservation of turning fractions" or "first-in-first-out" (FIFO) constraint, and how it often produces unrealistic spillback. This spillback occurs when, at a diverge, a queue develops for a movement that only a few lanes service, but FIFO requires that all lanes experience spillback from this queue. As we show, avoiding this unrealistic spillback while retaining FIFO in the node model requires complicated network topologies. Our second contribution is a "partial FIFO" mechanism that avoids this unrealistic spillback, and a node model and solution algorithm that incorporates this mechanism. The partial FIFO mechanism is parameterized through intervals that describe how individual movements influence each other, can be intuitively described from physical lane geometry and turning movement rules, and allows tuning to describe a link as having anything between full FIFO and no FIFO. Excepting the FIFO constraint, the present node model also fits within the well-established "general class of first-order node models" for multi-commodity flows.

Francois Belletti, Daniel Haziza, Gabriel Gomes et al.

This article shows how the recent breakthroughs in Reinforcement Learning (RL) that have enabled robots to learn to play arcade video games, walk or assemble colored bricks, can be used to perform other tasks that are currently at the core of engineering cyberphysical systems. We present the first use of RL for the control of systems modeled by discretized non-linear Partial Differential Equations (PDEs) and devise a novel algorithm to use non-parametric control techniques for large multi-agent systems. We show how neural network based RL enables the control of discretized PDEs whose parameters are unknown, random, and time-varying. We introduce an algorithm of Mutual Weight Regularization (MWR) which alleviates the curse of dimensionality of multi-agent control schemes by sharing experience between agents while giving each agent the opportunity to specialize its action policy so as to tailor it to the local parameters of the part of the system it is located in.

Matthew Wright, Gabriel Gomes, Roberto Horowitz et al.

We propose a macroscopic modeling framework for a network of roads and multi-commodity traffic. The proposed framework is based on the Lighthill-Whitham-Richards kinematic wave theory; more precisely, on its discretization, the Cell Transmission Model (CTM), adapted for networks and multi-commodity traffic. The resulting model is called the Link-Node CTM (LNCTM). In the LNCTM, we use the fundamental diagram of an "inverse lambda" shape that allows modeling of the capacity drop and the hysteresis behavior of the traffic state in a link that goes from free flow to congestion and back. A model of the node with multiple input and multiple output links accepting multi-commodity traffic is a cornerstone of the LNCTM. We present the multi-input-multi-output (MIMO) node model for multi-commodity traffic that supersedes previously developed node models. The analysis and comparison with previous node models are provided. Sometimes, certain traffic commodities may choose between multiple output links in a node based on the current traffic state of the node's input and output links. For such situations, we propose a local traffic assignment algorithm that computes how incoming traffic of a certain commodity should be distributed between output links, if this information is not known a priori.