Thomas E. Ouldridge

William Poole, Thomas E. Ouldridge, Manoj Gopalkrishnan

Can a micron sized sack of interacting molecules autonomously learn an internal model of a complex and fluctuating environment? We draw insights from control theory, machine learning theory, chemical reaction network theory, and statistical physics to develop a general architecture whereby a broad class of chemical systems can autonomously learn complex distributions. Our construction takes the form of a chemical implementation of machine learning's optimization workhorse: gradient descent on the relative entropy cost function. We show how this method can be applied to optimize any detailed balanced chemical reaction network and that the construction is capable of using hidden units to learn complex distributions. This result is then recast as a form of integral feedback control. Finally, due to our use of an explicit physical model of learning, we are able to derive thermodynamic costs and trade-offs associated to this process.

Ruslan L. Davidchack, Thomas E. Ouldridge, Michael V. Tretyakov

We introduce new Langevin-type equations describing the rotational and translational motion of rigid bodies interacting through conservative and non-conservative forces, and hydrodynamic coupling. In the absence of non-conservative forces the Langevin-type equations sample from the canonical ensemble. The rotational degrees of freedom are described using quaternions, the lengths of which are exactly preserved by the stochastic dynamics. For the proposed Langevin-type equations, we construct a weak 2nd order geometric integrator which preserves the main geometric features of the continuous dynamics. The integrator uses Verlet-type splitting for the deterministic part of Langevin equations appropriately combined with an exactly integrated Ornstein-Uhlenbeck process. Numerical experiments are presented to illustrate both the new Langevin model and the numerical method for it, as well as to demonstrate how inertia and the coupling of rotational and translational motion can introduce qualitatively distinct behaviours.