Perspectives on the State and Future of Deep Learning - 2023
It provides a periodic overview for the ML community, but is incremental as it updates existing survey efforts.
This paper presents a survey of current opinions and issues in machine learning, covering topics such as interpretable AI, benchmarking in NLP, understanding deep learning, and the future of academia, without reporting specific results or numbers.
The goal of this series is to chronicle opinions and issues in the field of machine learning as they stand today and as they change over time. The plan is to host this survey periodically until the AI singularity paperclip-frenzy-driven doomsday, keeping an updated list of topical questions and interviewing new community members for each edition. In this issue, we probed people's opinions on interpretable AI, the value of benchmarking in modern NLP, the state of progress towards understanding deep learning, and the future of academia.