Towards impactful challenges: post-challenge paper, benchmarks and other dissemination actions
It provides guidance for organizers to enhance dissemination and sustainability of AI challenges, but it is incremental as it builds on existing practices without introducing new technical methods.
This work addresses the problem of ensuring long-lasting impact after AI challenges by outlining post-challenge activities, including identifying target audiences and organizing outputs, with a focus on creating a template for post-challenge papers and benchmarks.
The conclusion of an AI challenge is not the end of its lifecycle; ensuring a long-lasting impact requires meticulous post-challenge activities. The long-lasting impact also needs to be organised. This chapter covers the various activities after the challenge is formally finished. This work identifies target audiences for post-challenge initiatives and outlines methods for collecting and organizing challenge outputs. The multiple outputs of the challenge are listed, along with the means to collect them. The central part of the chapter is a template for a typical post-challenge paper, including possible graphs and advice on how to turn the challenge into a long-lasting benchmark.