Exploring the use of AI authors and reviewers at Agents4Science
This addresses the need to understand AI's role in scientific research for researchers and AI developers, but it is incremental as it builds on existing interest without introducing new methods.
The paper tackled the problem of evaluating AI agents' capabilities as scientists and reviewers by organizing Agents4Science, the first conference where AI agents served as primary authors and reviewers, with humans in supporting roles, and discussed key learnings for human-AI collaboration in science.
There is growing interest in using AI agents for scientific research, yet fundamental questions remain about their capabilities as scientists and reviewers. To explore these questions, we organized Agents4Science, the first conference in which AI agents serve as both primary authors and reviewers, with humans as co-authors and co-reviewers. Here, we discuss the key learnings from the conference and their implications for human-AI collaboration in science.