CVAIJul 18, 2024

Cross-Task Attack: A Self-Supervision Generative Framework Based on Attention Shift

arXiv:2407.13700v115 citationsh-index: 8
Originality Incremental advance
AI Analysis

This addresses a gap in adversarial attack methods for comprehensive AI systems, though it appears incremental by extending attacks to multi-task scenarios.

The paper tackles the problem of adversarial attacks in multi-task AI systems, proposing a self-supervised framework that uses attention shift to generate cross-task perturbations, with experimental results confirming its effectiveness across multiple vision tasks.

Studying adversarial attacks on artificial intelligence (AI) systems helps discover model shortcomings, enabling the construction of a more robust system. Most existing adversarial attack methods only concentrate on single-task single-model or single-task cross-model scenarios, overlooking the multi-task characteristic of artificial intelligence systems. As a result, most of the existing attacks do not pose a practical threat to a comprehensive and collaborative AI system. However, implementing cross-task attacks is highly demanding and challenging due to the difficulty in obtaining the real labels of different tasks for the same picture and harmonizing the loss functions across different tasks. To address this issue, we propose a self-supervised Cross-Task Attack framework (CTA), which utilizes co-attention and anti-attention maps to generate cross-task adversarial perturbation. Specifically, the co-attention map reflects the area to which different visual task models pay attention, while the anti-attention map reflects the area that different visual task models neglect. CTA generates cross-task perturbations by shifting the attention area of samples away from the co-attention map and closer to the anti-attention map. We conduct extensive experiments on multiple vision tasks and the experimental results confirm the effectiveness of the proposed design for adversarial attacks.

Foundations

The foundational work for this paper's niche, ranked by how specifically the neighbourhood builds on it — not by global fame.

Your Notes