ScrawlD: A Dataset of Real World Ethereum Smart Contracts Labelled with Vulnerabilities
This provides a needed unbiased benchmark for the Ethereum community to assess and improve security tools, though it is incremental as it builds on existing detection methods.
The authors tackled the lack of a standardized benchmark for evaluating vulnerability detection tools in Ethereum smart contracts by creating ScrawlD, a dataset of real-world contracts labeled with vulnerabilities using majority voting from five tools.
Smart contracts on Ethereum handle millions of U.S. Dollars and other financial assets. In the past, attackers have exploited smart contracts to steal these assets. The Ethereum community has developed plenty of tools to detect vulnerable smart contracts. However, there is no standardized data set to evaluate these existing tools, or any new tools developed. There is a need for an unbiased standard benchmark of real-world Ethereum smart contracts. We have created ScrawlD: an annotated data set of real-world smart contracts taken from the Ethereum network. The data set is labelled using 5 tools that detect various vulnerabilities in smart contracts, using majority voting.