Diagnostic Text-guided Representation Learning in Hierarchical Classification for Pathological Whole Slide Image
This work addresses the challenge of complex lesion diversity in cancer diagnosis using WSI, offering a new perspective for more advanced pathology tasks, though it appears incremental in its approach.
The authors tackled the problem of hierarchical classification in pathological whole slide images by proposing PathTree, a representation learning method that uses diagnostic text descriptions to guide hierarchical feature aggregation, achieving competitive performance compared to state-of-the-art methods on three datasets.
With the development of digital imaging in medical microscopy, artificial intelligent-based analysis of pathological whole slide images (WSIs) provides a powerful tool for cancer diagnosis. Limited by the expensive cost of pixel-level annotation, current research primarily focuses on representation learning with slide-level labels, showing success in various downstream tasks. However, given the diversity of lesion types and the complex relationships between each other, these techniques still deserve further exploration in addressing advanced pathology tasks. To this end, we introduce the concept of hierarchical pathological image classification and propose a representation learning called PathTree. PathTree considers the multi-classification of diseases as a binary tree structure. Each category is represented as a professional pathological text description, which messages information with a tree-like encoder. The interactive text features are then used to guide the aggregation of hierarchical multiple representations. PathTree uses slide-text similarity to obtain probability scores and introduces two extra tree specific losses to further constrain the association between texts and slides. Through extensive experiments on three challenging hierarchical classification datasets: in-house cryosectioned lung tissue lesion identification, public prostate cancer grade assessment, and public breast cancer subtyping, our proposed PathTree is consistently competitive compared to the state-of-the-art methods and provides a new perspective on the deep learning-assisted solution for more complex WSI classification.