Scalar Federated Learning for Linear Quadratic Regulator
This addresses communication bottlenecks in federated control systems for applications like robotics or IoT, though it is incremental as it builds on existing federated and LQR frameworks.
The paper tackled the problem of communication-efficient federated learning for linear quadratic regulator (LQR) control in heterogeneous agents, proposing ScalarFedLQR, which reduces per-agent uplink communication from O(d) to O(1) and achieves linear convergence with performance comparable to full-gradient methods.
We propose ScalarFedLQR, a communication-efficient federated algorithm for model-free learning of a common policy in linear quadratic regulator (LQR) control of heterogeneous agents. The method builds on a decomposed projected gradient mechanism, in which each agent communicates only a scalar projection of a local zeroth-order gradient estimate. The server aggregates these scalar messages to reconstruct a global descent direction, reducing per-agent uplink communication from O(d) to O(1), independent of the policy dimension. Crucially, the projection-induced approximation error diminishes as the number of participating agents increases, yielding a favorable scaling law: larger fleets enable more accurate gradient recovery, admit larger stepsizes, and achieve faster linear convergence despite high dimensionality. Under standard regularity conditions, all iterates remain stabilizing and the average LQR cost decreases linearly fast. Numerical results demonstrate performance comparable to full-gradient federated LQR with substantially reduced communication.