CVAIJul 10

ALICE: Learning a General-Purpose Pathology Foundation Model from Vision, Vision-Language, and Slide-Level Experts

arXiv:2607.0952613.8Has Code
Predicted impact top 22% in CV · last 90 daysOriginality Incremental advance
AI Analysis

For computational pathology researchers, ALICE provides a single foundation model that consolidates complementary capabilities from diverse pretrained experts, eliminating the need to use separate backbones for different tasks.

ALICE unifies eight specialized pathology models into a single backbone via multi-stage agglomerative distillation, achieving the best average rank across 96 tasks in region-of-interest, vision-language, and whole-slide evaluations.

Foundation models are reshaping computational pathology, yet their capabilities remain shaped by pretraining objectives, data sources, and spatial scales, fragmenting complementary expertise across separate backbones. Here we present ALICE, a unified foundation model trained through multi-stage agglomerative distillation that sequentially distills eight vision-only, vision-language, and slide-level teacher models into dedicated modules of a single backbone. ALICE is pretrained on 24,985,184 tile-level pathology images and 155,604 high-resolution images, and evaluated across 21 task scenarios, 96 downstream tasks, and 48 data sources, spanning region-of-interest tissue analysis, vision-language multimodal evaluation, and whole-slide clinical assessment. In all three evaluation settings, ALICE achieved the best average rank among task-matched pathology foundation models. These results demonstrate that agglomerative distillation can consolidate complementary capabilities from specialized models into a unified backbone for broad computational pathology applications. The model is available at https://github.com/WonderLandxD/ALICE.

Code Implementations1 repo
Foundations

The foundational work for this paper's niche, ranked by how specifically the neighbourhood builds on it — not by global fame.

Your Notes