LGIROct 23, 2023

Towards Hybrid-grained Feature Interaction Selection for Deep Sparse Network

arXiv:2310.15342v24 citationsh-index: 13
Originality Incremental advance
AI Analysis

This work addresses a specific bottleneck in deep sparse networks for prediction tasks with high-dimensional sparse features, representing an incremental advancement.

The paper tackles the problem of feature interaction selection in deep sparse networks by introducing a hybrid-grained approach that targets both feature field and feature value, resulting in improved accuracy and efficiency as demonstrated on three large real-world benchmark datasets.

Deep sparse networks are widely investigated as a neural network architecture for prediction tasks with high-dimensional sparse features, with which feature interaction selection is a critical component. While previous methods primarily focus on how to search feature interaction in a coarse-grained space, less attention has been given to a finer granularity. In this work, we introduce a hybrid-grained feature interaction selection approach that targets both feature field and feature value for deep sparse networks. To explore such expansive space, we propose a decomposed space which is calculated on the fly. We then develop a selection algorithm called OptFeature, which efficiently selects the feature interaction from both the feature field and the feature value simultaneously. Results from experiments on three large real-world benchmark datasets demonstrate that OptFeature performs well in terms of accuracy and efficiency. Additional studies support the feasibility of our method.

Code Implementations1 repo
Foundations

The foundational work for this paper's niche, ranked by how specifically the neighbourhood builds on it — not by global fame.

Your Notes