TREB: a BERT attempt for imputing tabular data imputation
This work addresses the critical issue of missing data imputation for tabular datasets, which is incremental as it adapts an existing BERT model to a specific domain task.
The paper tackles the problem of imputing missing values in tabular data by introducing TREB, a BERT-based framework fine-tuned for this task, which demonstrates effectiveness in preserving feature interrelationships and accurately imputing values, with results validated on the California Housing dataset and including metrics on computational efficiency and environmental impact such as FLOPs and carbon footprint.
TREB, a novel tabular imputation framework utilizing BERT, introduces a groundbreaking approach for handling missing values in tabular data. Unlike traditional methods that often overlook the specific demands of imputation, TREB leverages the robust capabilities of BERT to address this critical task. While many BERT-based approaches for tabular data have emerged, they frequently under-utilize the language model's full potential. To rectify this, TREB employs a BERT-based model fine-tuned specifically for the task of imputing real-valued continuous numbers in tabular datasets. The paper comprehensively addresses the unique challenges posed by tabular data imputation, emphasizing the importance of context-based interconnections. The effectiveness of TREB is validated through rigorous evaluation using the California Housing dataset. The results demonstrate its ability to preserve feature interrelationships and accurately impute missing values. Moreover, the authors shed light on the computational efficiency and environmental impact of TREB, quantifying the floating-point operations (FLOPs) and carbon footprint associated with its training and deployment.