Haidong Zhang

Qixu Chen, Yeye He, Raymond Chi-Wing Wong et al.

Data cleaning is a long-standing challenge in data management. While powerful logic and statistical algorithms have been developed to detect and repair data errors in tables, existing algorithms predominantly rely on domain-experts to first manually specify data-quality constraints specific to a given table, before data cleaning algorithms can be applied. In this work, we propose a new class of data-quality constraints that we call Semantic-Domain Constraints, which can be reliably inferred and automatically applied to any tables, without requiring domain-experts to manually specify on a per-table basis. We develop a principled framework to systematically learn such constraints from table corpora using large-scale statistical tests, which can further be distilled into a core set of constraints using our optimization framework, with provable quality guarantees. Extensive evaluations show that this new class of constraints can be used to both (1) directly detect errors on real tables in the wild, and (2) augment existing expert-driven data-cleaning techniques as a new class of complementary constraints. Our extensively labeled benchmark dataset with 2400 real data columns, as well as our code are available at https://github.com/qixuchen/AutoTest to facilitate future research.

Wei Zhao, Zhitao Hou, Siyuan Wu et al.

Writing formulas on spreadsheets, such as Microsoft Excel and Google Sheets, is a widespread practice among users performing data analysis. However, crafting formulas on spreadsheets remains a tedious and error-prone task for many end-users, particularly when dealing with complex operations. To alleviate the burden associated with writing spreadsheet formulas, this paper introduces a novel benchmark task called NL2Formula, with the aim to generate executable formulas that are grounded on a spreadsheet table, given a Natural Language (NL) query as input. To accomplish this, we construct a comprehensive dataset consisting of 70,799 paired NL queries and corresponding spreadsheet formulas, covering 21,670 tables and 37 types of formula functions. We realize the NL2Formula task by providing a sequence-to-sequence baseline implementation called fCoder. Experimental results validate the effectiveness of fCoder, demonstrating its superior performance compared to the baseline models. Furthermore, we also compare fCoder with an initial GPT-3.5 model (i.e., text-davinci-003). Lastly, through in-depth error analysis, we identify potential challenges in the NL2Formula task and advocate for further investigation.

Haidong Zhang, Chaoqian Wang, Shuo Liu et al.

Trust is one of the cornerstones of human society. One of the evolutionary pressure mechanisms that may have led to its emergence is the presence of incentives for trustworthy behavior. However, this type of reward has received relatively little attention in the context of spatial trust games, which are often used to build models in evolutionary game theory. To fill this gap, we introduce an inter-role reward mechanism in the spatial trust game, so that an investing trustor can choose to pay an extra cost to reward a trustworthy trustee. With extensive numerical simulations, we find that this type of reward does not always promote trust. Rather, while moderate rewards break the dominance of mistrust, thereby favoring investment, excessive rewards eventually stimulate a nonreturn strategy, ultimately suppressing the evolution of trust. Additionally, lower reward costs do not necessarily promote trust. Instead, more costly, but not excessive, rewards enhance the advantage of the original investment, consolidating the clusters of rewarders and improving trust. Our model thus provides evidence about the counterintuitive nature of the relationship between trust and rewards in a complex society.