LGNov 15, 2022

Multi-Label Quantification

arXiv:2211.08063v15 citationsh-index: 46
AI Analysis

This addresses a gap in supervised learning for multi-label settings, which is important for applications like text categorization or medical diagnosis where classes overlap, though it is incremental as it extends existing quantification methods to a new scenario.

The paper tackles the problem of multi-label quantification, where classes are not mutually exclusive, by proposing the first truly multi-label methods that leverage dependencies among classes to predict relative frequencies more accurately. It shows that these methods outperform naïve independent binary approaches by a large margin, with empirical evidence supporting the improvement.

Quantification, variously called "supervised prevalence estimation" or "learning to quantify", is the supervised learning task of generating predictors of the relative frequencies (a.k.a. "prevalence values") of the classes of interest in unlabelled data samples. While many quantification methods have been proposed in the past for binary problems and, to a lesser extent, single-label multiclass problems, the multi-label setting (i.e., the scenario in which the classes of interest are not mutually exclusive) remains by and large unexplored. A straightforward solution to the multi-label quantification problem could simply consist of recasting the problem as a set of independent binary quantification problems. Such a solution is simple but naïve, since the independence assumption upon which it rests is, in most cases, not satisfied. In these cases, knowing the relative frequency of one class could be of help in determining the prevalence of other related classes. We propose the first truly multi-label quantification methods, i.e., methods for inferring estimators of class prevalence values that strive to leverage the stochastic dependencies among the classes of interest in order to predict their relative frequencies more accurately. We show empirical evidence that natively multi-label solutions outperform the naïve approaches by a large margin. The code to reproduce all our experiments is available online.

Code Implementations1 repo
Foundations

The foundational work for this paper's niche, ranked by how specifically the neighbourhood builds on it — not by global fame.

Your Notes