Mutation Testing for Ethereum Smart Contract
This work addresses quality assurance for Ethereum smart contract developers and users, offering a significant improvement over existing methods but is incremental in applying mutation testing to this specific domain.
The paper tackles the problem of ensuring correctness in Ethereum smart contracts by proposing a mutation testing framework with 15 novel operators, achieving a defect detection rate of 96.01% compared to 55.68% for coverage-based approaches and identifying 117 real bug reports out of 729.
Smart contract is a special program that manages digital assets on blockchain. It is difficult to recover the loss if users make transactions through buggy smart contracts, which cannot be directly fixed. Hence, it is important to ensure the correctness of smart contracts before deploying them. This paper proposes a systematic framework to mutation testing for smart contracts on Ethereum, which is currently the most popular open blockchain for deploying and running smart contracts. Fifteen novel mutation operators have been designed for Ethereum Smart Contracts (ESC), in terms of keyword, global variable/function, variable unit, and error handling. An empirical study on 26 smart contracts in four Ethereum DApps has been conducted to evaluate the effectiveness of mutation testing. The experimental results show that our approach can outperform the coverage-based approach on defect detection rate (96.01% vs. 55.68%). The ESC mutation operators are effective to reveal real defects and we found 117 out of 729 real bug reports are related to our operators. These show the great potential of using mutation testing for quality assurance of ESC.