Simone Baldi

Linda Chen, Niranjan Saikumar, Simone Baldi et al.

In this paper a novel reset control synthesis method is proposed: CRONE reset control, combining a robust fractional CRONE controller with non-linear reset control to overcome waterbed effect. In CRONE control, robustness is achieved by creation of constant phase behaviour around bandwidth with the use of fractional operators, also allowing more freedom in shaping the open-loop frequency response. However, being a linear controller it suffers from the inevitable trade-off between robustness and performance as a result of the waterbed effect. Here reset control is introduced in the CRONE design to overcome the fundamental limitations. In the new controller design, reset phase advantage is approximated using describing function analysis and used to achieve better open-loop shape. Sufficient quadratic stability conditions are shown for the designed CRONE reset controllers and the control design is validated on a Lorentz-actuated nanometre precision stage. It is shown that for similar phase margin, better performance in terms of reference-tracking and noise attenuation can be achieved.

Saksham Gupta, Rishabh Dev Yadav, Sarthak Mishra et al.

This paper addresses the challenge of simultaneously compensating for state-dependent uncertainties and enforcing time-varying state constraints in Euler-Lagrange systems, a common requirement in robotics that remains underserved by existing control designs. A novel adaptive control framework is developed that combines an artificial time-delay-based uncertainty estimation strategy, also known as time-delay estimation, with a barrier Lyapunov function to enforce constraint-aware control design. Specifically, a state-dependent upper bound on the time-delay estimation approximation error is analytically formulated, and an adaptive law is constructed to estimate its parameters online, enabling real-time state-dependent uncertainty compensation without relying on prior model knowledge. To ensure constraint compliance, the barrier Lyapunov function-based controller enforces time-varying bounds on both position and velocity. The resulting architecture is provably stable via Lyapunov analysis. Experimental results on a five-degree-of-freedom robotic manipulator validate the framework's capability, compared with the state of the art, in maintaining strict adherence to safety-critical constraints under dynamic uncertainties.

Thomas M. Moerland, Anna Deichler, Simone Baldi et al.

Planning and reinforcement learning are two key approaches to sequential decision making. Multi-step approximate real-time dynamic programming, a recently successful algorithm class of which AlphaZero [Silver et al., 2018] is an example, combines both by nesting planning within a learning loop. However, the combination of planning and learning introduces a new question: how should we balance time spend on planning, learning and acting? The importance of this trade-off has not been explicitly studied before. We show that it is actually of key importance, with computational results indicating that we should neither plan too long nor too short. Conceptually, we identify a new spectrum of planning-learning algorithms which ranges from exhaustive search (long planning) to model-free RL (no planning), with optimal performance achieved midway.