Large Language Models for Combinatorial Optimization: A Systematic Review
This provides a comprehensive overview for researchers and practitioners working on LLMs in optimization, but it is an incremental review paper rather than novel research.
This systematic review analyzed over 2,000 publications to survey how Large Language Models (LLMs) are applied in Combinatorial Optimization (CO), selecting 103 studies to categorize tasks, architectures, datasets, and applications while identifying future research directions.
This systematic review explores the application of Large Language Models (LLMs) in Combinatorial Optimization (CO). We report our findings using the Preferred Reporting Items for Systematic Reviews and Meta-Analyses (PRISMA) guidelines. We conduct a literature search via Scopus and Google Scholar, examining over 2,000 publications. We assess publications against four inclusion and four exclusion criteria related to their language, research focus, publication year, and type. Eventually, we select 103 studies. We classify these studies into semantic categories and topics to provide a comprehensive overview of the field, including the tasks performed by LLMs, the architectures of LLMs, the existing datasets specifically designed for evaluating LLMs in CO, and the field of application. Finally, we identify future directions for leveraging LLMs in this field.