Evaluating Rank-N-Contrast: Continuous and Robust Representations for Regression
This is an incremental replication study that validates and extends the original method for improving regression models in machine learning.
The study reproduced and evaluated the Rank-N-Contrast framework, which tackles the problem of deep regression models failing to capture continuous sample orders, resulting in improved performance and robustness, including state-of-the-art results on an additional dataset.
This document is an evaluation of the original "Rank-N-Contrast" (arXiv:2210.01189v2) paper published in 2023. This evaluation is done for academic purposes. Deep regression models often fail to capture the continuous nature of sample orders, creating fragmented representations and suboptimal performance. To address this, we reproduced the Rank-N-Contrast (RNC) framework, which learns continuous representations by contrasting samples by their rankings in the target space. Our study validates RNC's theoretical and empirical benefits, including improved performance and robustness. We extended the evaluation to an additional regression dataset and conducted robustness tests using a holdout method, where a specific range of continuous data was excluded from the training set. This approach assessed the model's ability to generalize to unseen data and achieve state-of-the-art performance. This replication study validates the original findings and broadens the understanding of RNC's applicability and robustness.