Anders Åhlén

Ivo Herman, Steffi Knorn, Anders Ahlén

This paper considers a string of vehicles where the local control law uses the states of the vehicle's immediate predecessor and follower. The coupling towards the preceding vehicle can be chosen different to the coupling towards the following vehicle, which is often referred to as an asymmetric bidirectional string. Further, the asymmetry for the velocity coupling can be chosen differently to the asymmetry in the position coupling. It is investigated how the effect of disturbance on the control errors in the string depends on the string length. It is shown, that in case of symmetric position coupling and asymmetric velocity coupling, linear scaling can be achieved. For symmetric interaction in both states, i.e., in symmetric bidirectional strings, the errors scale quadratically in the number of vehicles. When the coupling in position is asymmetric, exponential scaling may occur or the system might even become unstable. The paper thus gives a comprehensive overview of the achievable performance in linear, asymmetric, bidirectional platoons. The results reveal that symmetry in the position coupling and asymmetry in velocity coupling qualitatively improves the performance of the string. Extensive numerical results illustrate the theoretical findings.

Somayeh Salimi, Subhrakanti Dey, Anders Ahlen

In this paper, we investigate the role of a physical watermarking signal in quickest detection of a deception attack in a scalar linear control system where the sensor measurements can be replaced by an arbitrary stationary signal generated by an attacker. By adding a random watermarking signal to the control action, the controller designs a sequential test based on a Cumulative Sum (CUSUM) method that accumulates the log-likelihood ratio of the joint distribution of the residue and the watermarking signal (under attack) and the joint distribution of the innovations and the watermarking signal under no attack. As the average detection delay in such tests is asymptotically (as the false alarm rate goes to zero) upper bounded by a quantity inversely proportional to the Kullback-Leibler divergence(KLD) measure between the two joint distributions mentioned above, we analyze the effect of the watermarking signal variance on the above KLD. We also analyze the increase in the LQG control cost due to the watermarking signal, and show that there is a tradeoff between quick detection of attacks and the penalty in the control cost. It is shown that by considering a sequential detection test based on the joint distributions of residue/innovations and the watermarking signal, as opposed to the distributions of the residue/innovations only, we can achieve a higher KLD, thus resulting in a reduced average detection delay. Numerical results are provided to support our claims.

Abbas Arghavani, Subhrakanti Dey, Anders Ahlen

This paper investigates covert wireless communication with a Fusion Center (FC) that aggregates raw energy measurements from multiple Wardens via soft fusion. Extending our prior work on power-threshold randomization, we consider a stronger adversarial model in which FC randomizes both the number of active Wardens W and the detection threshold t, while Alice and a friendly Jammer jointly randomize their transmit powers under an outage constraint at Bob. We derive a closed-form expression for FC's optimal soft-fusion threshold and show that it is independent of the number of active Wardens. Thus, strategic uncertainty in the sensing infrastructure provides no meaningful detection advantage for FC under soft fusion. We further establish a robustness theorem showing that, even under arbitrary FC randomization over (W,t), Alice and Jammer can maintain outage-feasible communication at Bob while preserving covertness with high probability, provided their power ranges are sufficiently large. This reveals a structural limitation of soft fusion. A game-theoretic formulation characterizes the Nash equilibrium mixed strategies of both sides, accounting for deployment costs and detection-pressure parameters. Analytical and numerical results show that: 1) soft fusion is largely insensitive to the number of Wardens; 2) even semi-strategic finite-support geometric randomization of W performs comparably to the full game-theoretic equilibrium; and 3) the covertness-reliability tradeoff remains nearly invariant across a wide range of FC deployment costs and strategy parameters. These findings exemplify a Red Queen effect, in which FC incurs increasing operational costs for only marginal gains in detection performance, and highlight the need for alternative detection architectures.

Martin Hellkvist, Ayça Özçelikkale, Anders Ahlén

We consider estimation under model misspecification where there is a model mismatch between the underlying system, which generates the data, and the model used during estimation. We propose a model misspecification framework which enables a joint treatment of the model misspecification types of having fake features as well as incorrect covariance assumptions on the unknowns and the noise. We present a decomposition of the output error into components that relate to different subsets of the model parameters corresponding to underlying, fake and missing features. Here, fake features are features which are included in the model but are not present in the underlying system. Under this framework, we characterize the estimation performance and reveal trade-offs between the number of samples, number of fake features, and the possibly incorrect noise level assumption. In contrast to existing work focusing on incorrect covariance assumptions or missing features, fake features is a central component of our framework. Our results show that fake features can significantly improve the estimation performance, even though they are not correlated with the features in the underlying system. In particular, we show that the estimation error can be decreased by including more fake features in the model, even to the point where the model is overparametrized, i.e., the model contains more unknowns than observations.

Martin Hellkvist, Ayça Özçelikkale, Anders Ahlén

We focus on the continual learning problem where the tasks arrive sequentially and the aim is to perform well on the newly arrived task without performance degradation on the previously seen tasks. In contrast to the continual learning literature focusing on the centralized setting, we investigate the distributed estimation framework. We consider the well-established distributed learning algorithm COCOA. We derive closed form expressions for the iterations for the overparametrized case. We illustrate the convergence and the error performance of the algorithm based on the over/under-parameterization of the problem. Our results show that depending on the problem dimensions and data generation assumptions, COCOA can perform continual learning over a sequence of tasks, i.e., it can learn a new task without forgetting previously learned tasks, with access only to one task at a time.

Martin Hellkvist, Ayça Özçelikkale, Anders Ahlén

Recent successes of massively overparameterized models have inspired a new line of work investigating the underlying conditions that enable overparameterized models to generalize well. This paper considers a framework where the possibly overparametrized model includes fake features, i.e., features that are present in the model but not in the data. We present a non-asymptotic high-probability bound on the generalization error of the ridge regression problem under the model misspecification of having fake features. Our highprobability results provide insights into the interplay between the implicit regularization provided by the fake features and the explicit regularization provided by the ridge parameter. Numerical results illustrate the trade-off between the number of fake features and how the optimal ridge parameter may heavily depend on the number of fake features.

Martin Hellkvist, Ayça Özçelikkale, Anders Ahlén

We consider estimation under scenarios where the signals of interest exhibit change of characteristics over time. In particular, we consider the continual learning problem where different tasks, e.g., data with different distributions, arrive sequentially and the aim is to perform well on the newly arrived task without performance degradation on the previously seen tasks. In contrast to the continual learning literature focusing on the centralized setting, we investigate the problem from a distributed estimation perspective. We consider the well-established distributed learning algorithm COCOA, which distributes the model parameters and the corresponding features over the network. We provide exact analytical characterization for the generalization error of COCOA under continual learning for linear regression in a range of scenarios, where overparameterization is of particular interest. These analytical results characterize how the generalization error depends on the network structure, the task similarity and the number of tasks, and show how these dependencies are intertwined. In particular, our results show that the generalization error can be significantly reduced by adjusting the network size, where the most favorable network size depends on task similarity and the number of tasks. We present numerical results verifying the theoretical analysis and illustrate the continual learning performance of COCOA with a digit classification task.

Martin Hellkvist, Ayça Özçelikkale, Anders Ahlén

Distributed learning provides an attractive framework for scaling the learning task by sharing the computational load over multiple nodes in a network. Here, we investigate the performance of distributed learning for large-scale linear regression where the model parameters, i.e., the unknowns, are distributed over the network. We adopt a statistical learning approach. In contrast to works that focus on the performance on the training data, we focus on the generalization error, i.e., the performance on unseen data. We provide high-probability bounds on the generalization error for both isotropic and correlated Gaussian data as well as sub-gaussian data. These results reveal the dependence of the generalization performance on the partitioning of the model over the network. In particular, our results show that the generalization error of the distributed solution can be substantially higher than that of the centralized solution even when the error on the training data is at the same level for both the centralized and distributed approaches. Our numerical results illustrate the performance with both real-world image data as well as synthetic data.

Martin Hellkvist, Ayça Özçelikkale, Anders Ahlén

Distributed learning facilitates the scaling-up of data processing by distributing the computational burden over several nodes. Despite the vast interest in distributed learning, generalization performance of such approaches is not well understood. We address this gap by focusing on a linear regression setting. We consider the setting where the unknowns are distributed over a network of nodes. We present an analytical characterization of the dependence of the generalization error on the partitioning of the unknowns over nodes. In particular, for the overparameterized case, our results show that while the error on training data remains in the same range as that of the centralized solution, the generalization error of the distributed solution increases dramatically compared to that of the centralized solution when the number of unknowns estimated at any node is close to the number of observations. We further provide numerical examples to verify our analytical expressions.