ALT: An Automatic System for Long Tail Scenario Modeling
This addresses a common but understudied issue in applications where resources are constrained, offering a practical solution for scenarios with limited human, time, and computing resources.
The paper tackles the problem of long tail scenario modeling under budget limitations, presenting an automatic system called ALT that employs various AutoML techniques, meta learning, and a budget-limited neural architecture search method, with experiments and online results verifying its effectiveness.
In this paper, we consider the problem of long tail scenario modeling with budget limitation, i.e., insufficient human resources for model training stage and limited time and computing resources for model inference stage. This problem is widely encountered in various applications, yet has received deficient attention so far. We present an automatic system named ALT to deal with this problem. Several efforts are taken to improve the algorithms used in our system, such as employing various automatic machine learning related techniques, adopting the meta learning philosophy, and proposing an essential budget-limited neural architecture search method, etc. Moreover, to build the system, many optimizations are performed from a systematic perspective, and essential modules are armed, making the system more feasible and efficient. We perform abundant experiments to validate the effectiveness of our system and demonstrate the usefulness of the critical modules in our system. Moreover, online results are provided, which fully verified the efficacy of our system.