a survey on GPT-3
It offers a comprehensive overview for researchers and practitioners interested in understanding GPT-3's capabilities and limitations, but it is incremental as a survey without new experimental results.
This paper provides an introductory survey on GPT-3, covering its historical development, key features, model and datasets, applications across domains like conversational AI and software development, and challenges such as training complexity and bias.
This paper provides an introductory survey to GPT-3. We cover some of the historical development behind this technology, some of the key features of GPT-3, and discuss the machine learning model and the datasets used. We survey both academic and commercial efforts applying GPT-3 in diverse domains such as developing conversational AI chatbots, software development, creative work, domain knowledge, and business productivity. We discuss some of the challenges that GPT-3 faces such as the problems of training complexity, bias, and hallucination/incorrect answers. We also discuss the future research opportunities in this area.