MedSAE: Dissecting MedCLIP Representations with Sparse Autoencoders
This work addresses interpretability for medical vision models, offering a scalable approach to improve transparency in clinical AI applications.
The researchers tackled the problem of interpretability in medical AI by applying Medical Sparse Autoencoders (MedSAEs) to MedCLIP's latent space, resulting in neurons with higher monosemanticity and interpretability than raw features on the CheXpert dataset.
Artificial intelligence in healthcare requires models that are accurate and interpretable. We advance mechanistic interpretability in medical vision by applying Medical Sparse Autoencoders (MedSAEs) to the latent space of MedCLIP, a vision-language model trained on chest radiographs and reports. To quantify interpretability, we propose an evaluation framework that combines correlation metrics, entropy analyzes, and automated neuron naming via the MedGEMMA foundation model. Experiments on the CheXpert dataset show that MedSAE neurons achieve higher monosemanticity and interpretability than raw MedCLIP features. Our findings bridge high-performing medical AI and transparency, offering a scalable step toward clinically reliable representations.