Random Forest Autoencoders for Guided Representation Learning
This work addresses the challenge of scalable and generalizable supervised visualization for large datasets and label-scarce scenarios, representing an incremental improvement over prior methods.
The paper tackles the problem of supervised visualization by introducing Random Forest Autoencoders (RF-AE), a neural network framework that enables efficient out-of-sample supervised visualization and outperforms existing methods like RF-PHATE in accuracy and interpretability.
Extensive research has produced robust methods for unsupervised data visualization. Yet supervised visualization$\unicode{x2013}$where expert labels guide representations$\unicode{x2013}$remains underexplored, as most supervised approaches prioritize classification over visualization. Recently, RF-PHATE, a diffusion-based manifold learning method leveraging random forests and information geometry, marked significant progress in supervised visualization. However, its lack of an explicit mapping function limits scalability and its application to unseen data, posing challenges for large datasets and label-scarce scenarios. To overcome these limitations, we introduce Random Forest Autoencoders (RF-AE), a neural network-based framework for out-of-sample kernel extension that combines the flexibility of autoencoders with the supervised learning strengths of random forests and the geometry captured by RF-PHATE. RF-AE enables efficient out-of-sample supervised visualization and outperforms existing methods, including RF-PHATE's standard kernel extension, in both accuracy and interpretability. Additionally, RF-AE is robust to the choice of hyperparameters and generalizes to any kernel-based dimensionality reduction method.