3.4CLJun 6, 2024Code
BEADs: Bias Evaluation Across DomainsShaina Raza, Mizanur Rahman, Michael R. Zhang
Recent advances in large language models (LLMs) have substantially improved natural language processing (NLP) applications. However, these models often inherit and amplify biases present in their training data. Although several datasets exist for bias detection, most are limited to one or two NLP tasks, typically classification or evaluation and do not provide broad coverage across diverse task settings. To address this gap, we introduce the \textbf{Bias Evaluations Across Domains} (\textbf{B}\texttt{EADs}) dataset, designed to support a wide range of NLP tasks, including text classification, token classification, bias quantification, and benign language generation. A key contribution of this work is a gold-standard annotation scheme that supports both evaluation and supervised training of language models. Experiments on state-of-the-art models reveal some gaps: some models exhibit systematic bias toward specific demographics, while others apply safety guardrails more strictly or inconsistently across groups. Overall, these results highlight persistent shortcomings in current models and underscore the need for comprehensive bias evaluation. Project: https://vectorinstitute.github.io/BEAD/ Data: https://huggingface.co/datasets/shainar/BEAD
6.6CRJun 29, 2021
Decentralized Blockchain-based model for Edge ComputingMabrook S. Al-Rakhami, Abdu Gumaei, Sk. Md. Mizanur Rahman et al.
Blockchain technology is among the fastest-growing technologies in the world today. It has been adopted in diverse areas but mostly in financial systems, such as Bitcoin cryptocurrency. Therefore, it is a niche that has attracted interest from researchers from various fields, including computer science. Other areas where Blockchain is being embraced are the Smart Grid and Internet of Things (IoT) technologies, among others. While it is all good and improving many areas of applications, Blockchain still has some shortcomings. For example, it is not designed for high scalability when accommodating normal transactions. On the other hand, a parallel technology that has diverse applications in distributed networks better known as edge computing has emerged. Its main advantage is that it increases the speed of pf processes within those networks. However, like Blockchain, edge computing has its shortcomings. Its security systems and management systems have been found to be wanting. Hence the idea to integrate the two technologies and take advantage of their strengths. A blend of the two would lead to advanced network servers, huge data storage, and heightened security in transactions. However, this integration will best happen when some measures are taken. For example, there is a need to address scalability, resource management satisfactorily, and the security of the systems. To solve the integration problem, a decentralized Blockchain-based model of Edge computing is proposed in this paper.