ChemLLM: A Chemical Large Language Model
This addresses the need for domain-specific LLMs in chemistry, offering a new standard for integrating structured knowledge into dialogue systems, though it is incremental as it adapts existing LLM methods to a new domain.
The authors tackled the lack of a specialized large language model for chemistry by introducing ChemLLM, a framework that includes a dedicated LLM, a dataset for instruction tuning, and a benchmark covering nine tasks, achieving results comparable to GPT-4 on core chemical tasks.
Large language models (LLMs) have made impressive progress in chemistry applications. However, the community lacks an LLM specifically designed for chemistry. The main challenges are two-fold: firstly, most chemical data and scientific knowledge are stored in structured databases, which limits the model's ability to sustain coherent dialogue when used directly. Secondly, there is an absence of objective and fair benchmark that encompass most chemistry tasks. Here, we introduce ChemLLM, a comprehensive framework that features the first LLM dedicated to chemistry. It also includes ChemData, a dataset specifically designed for instruction tuning, and ChemBench, a robust benchmark covering nine essential chemistry tasks. ChemLLM is adept at performing various tasks across chemical disciplines with fluid dialogue interaction. Notably, ChemLLM achieves results comparable to GPT-4 on the core chemical tasks and demonstrates competitive performance with LLMs of similar size in general scenarios. ChemLLM paves a new path for exploration in chemical studies, and our method of incorporating structured chemical knowledge into dialogue systems sets a new standard for developing LLMs in various scientific fields. Codes, Datasets, and Model weights are publicly accessible at https://hf.co/AI4Chem