Small sample-based adaptive text classification through iterative and contrastive description refinement
This addresses the challenge of adapting text classification to evolving knowledge and limited supervision in real-world systems like ticketing, though it is incremental as it builds on existing prompt-based and active learning methods.
The paper tackled the problem of zero-shot text classification in dynamic domains with ambiguous categories by proposing a framework combining iterative topic refinement, contrastive prompting, and active learning, achieving 91% accuracy on AGNews and 84% on DBpedia with minimal performance drop when introducing unseen classes.
Zero-shot text classification remains a difficult task in domains with evolving knowledge and ambiguous category boundaries, such as ticketing systems. Large language models (LLMs) often struggle to generalize in these scenarios due to limited topic separability, while few-shot methods are constrained by insufficient data diversity. We propose a classification framework that combines iterative topic refinement, contrastive prompting, and active learning. Starting with a small set of labeled samples, the model generates initial topic labels. Misclassified or ambiguous samples are then used in an iterative contrastive prompting process to refine category distinctions by explicitly teaching the model to differentiate between closely related classes. The framework features a human-in-the-loop component, allowing users to introduce or revise category definitions in natural language. This enables seamless integration of new, unseen categories without retraining, making the system well-suited for real-world, dynamic environments. The evaluations on AGNews and DBpedia demonstrate strong performance: 91% accuracy on AGNews (3 seen, 1 unseen class) and 84% on DBpedia (8 seen, 1 unseen), with minimal accuracy shift after introducing unseen classes (82% and 87%, respectively). The results highlight the effectiveness of prompt-based semantic reasoning for fine-grained classification with limited supervision.