Localized Randomized Smoothing for Collective Robustness Certification
This work addresses the need for provable robustness in multi-output models against adversarial attacks, which is crucial for applications like image segmentation and node classification, representing a novel method for a known bottleneck rather than a foundational breakthrough.
The paper tackles the problem of collective robustness certification for models with multiple outputs, such as image segmentation and node classification, by proposing a localized randomized smoothing method that provably bounds the number of robust predictions under adversarial perturbations. The result shows that this approach Pareto-dominates existing certificates, offering higher accuracy and stronger certificates on tasks like image segmentation and node classification.
Models for image segmentation, node classification and many other tasks map a single input to multiple labels. By perturbing this single shared input (e.g. the image) an adversary can manipulate several predictions (e.g. misclassify several pixels). Collective robustness certification is the task of provably bounding the number of robust predictions under this threat model. The only dedicated method that goes beyond certifying each output independently is limited to strictly local models, where each prediction is associated with a small receptive field. We propose a more general collective robustness certificate for all types of models. We further show that this approach is beneficial for the larger class of softly local models, where each output is dependent on the entire input but assigns different levels of importance to different input regions (e.g. based on their proximity in the image). The certificate is based on our novel localized randomized smoothing approach, where the random perturbation strength for different input regions is proportional to their importance for the outputs. Localized smoothing Pareto-dominates existing certificates on both image segmentation and node classification tasks, simultaneously offering higher accuracy and stronger certificates.