CLMar 14, 2025

A Transformer and Prototype-based Interpretable Model for Contextual Sarcasm Detection

arXiv:2503.11838v11 citationsh-index: 12
Originality Incremental advance
AI Analysis

This addresses sarcasm detection for affective systems, offering an incremental improvement with enhanced interpretability.

The authors tackled sarcasm detection by proposing a transformer and prototype-based model that outperforms the state-of-the-art on three benchmark datasets, while providing intrinsic interpretability without extra techniques.

Sarcasm detection, with its figurative nature, poses unique challenges for affective systems designed to perform sentiment analysis. While these systems typically perform well at identifying direct expressions of emotion, they struggle with sarcasm's inherent contradiction between literal and intended sentiment. Since transformer-based language models (LMs) are known for their efficient ability to capture contextual meanings, we propose a method that leverages LMs and prototype-based networks, enhanced by sentiment embeddings to conduct interpretable sarcasm detection. Our approach is intrinsically interpretable without extra post-hoc interpretability techniques. We test our model on three public benchmark datasets and show that our model outperforms the current state-of-the-art. At the same time, the prototypical layer enhances the model's inherent interpretability by generating explanations through similar examples in the reference time. Furthermore, we demonstrate the effectiveness of incongruity loss in the ablation study, which we construct using sentiment prototypes.

Foundations

The foundational work for this paper's niche, ranked by how specifically the neighbourhood builds on it — not by global fame.

Your Notes