An Evaluation of Large Language Models in Bioinformatics Research
This work assesses the potential of LLMs for bioinformatics researchers, but it is incremental as it applies existing methods to a new domain without introducing novel techniques.
The paper evaluated large language models (LLMs) like ChatGPT on various bioinformatics tasks, such as gene identification and peptide detection, finding that with proper prompting, LLMs can successfully handle most tasks, though limitations exist for complex ones.
Large language models (LLMs) such as ChatGPT have gained considerable interest across diverse research communities. Their notable ability for text completion and generation has inaugurated a novel paradigm for language-interfaced problem solving. However, the potential and efficacy of these models in bioinformatics remain incompletely explored. In this work, we study the performance LLMs on a wide spectrum of crucial bioinformatics tasks. These tasks include the identification of potential coding regions, extraction of named entities for genes and proteins, detection of antimicrobial and anti-cancer peptides, molecular optimization, and resolution of educational bioinformatics problems. Our findings indicate that, given appropriate prompts, LLMs like GPT variants can successfully handle most of these tasks. In addition, we provide a thorough analysis of their limitations in the context of complicated bioinformatics tasks. In conclusion, we believe that this work can provide new perspectives and motivate future research in the field of LLMs applications, AI for Science and bioinformatics.