HEDS 3.0: The Human Evaluation Data Sheet Version 3.0
This is an incremental update to a tool for researchers conducting human evaluations in fields like NLP or AI, enhancing usability but not introducing new methods.
The paper presents version 3.0 of the Human Evaluation Datasheet (HEDS), an update aimed at improving clarity and consistency for users in human evaluation experiments, based on feedback and experience from recent studies.
This paper presents version 3.0 of the Human Evaluation Datasheet (HEDS). This update is the result of our experience using HEDS in the context of numerous recent human evaluation experiments, including reproduction studies, and of feedback received. Our main overall goal was to improve clarity, and to enable users to complete the datasheet more consistently and comparably. The HEDS 3.0 package consists of the digital data sheet, documentation, and code for exporting completed data sheets as latex files, all available from the HEDS GitHub.