CYFeb 22, 2022
Towards User-Centered Metrics for Trustworthy AI in Immersive CyberspacePengyuan Zhou, Benjamin Finley, Lik-Hang Lee et al.
AI plays a key role in current cyberspace and future immersive ecosystems that pinpoint user experiences. Thus, the trustworthiness of such AI systems is vital as failures in these systems can cause serious user harm. Although there are related works on exploring trustworthy AI (TAI) metrics in the current cyberspace, ecosystems towards user-centered services, such as the metaverse, are much more complicated in terms of system performance and user experience assessment, thus posing challenges for the applicability of existing approaches. Thus, we give an overlook on fairness, privacy and robustness, across the historical path from existing approaches. Eventually, we propose a research agenda towards systematic yet user-centered TAI in immersive ecosystems.
MMJan 14, 2021
AICP: Augmented Informative Cooperative PerceptionPengyuan Zhou, Pranvera Kortoci, Yui-Pan Yau et al.
Connected vehicles, whether equipped with advanced driver-assistance systems or fully autonomous, require human driver supervision and are currently constrained to visual information in their line-of-sight. A cooperative perception system among vehicles increases their situational awareness by extending their perception range. Existing solutions focus on improving perspective transformation and fast information collection. However, such solutions fail to filter out large amounts of less relevant data and thus impose significant network and computation load. Moreover, presenting all this less relevant data can overwhelm the driver and thus actually hinder them. To address such issues, we present Augmented Informative Cooperative Perception (AICP), the first fast-filtering system which optimizes the informativeness of shared data at vehicles to improve the fused presentation. To this end, an informativeness maximization problem is presented for vehicles to select a subset of data to display to their drivers. Specifically, we propose (i) a dedicated system design with custom data structure and lightweight routing protocol for convenient data encapsulation, fast interpretation and transmission, and (ii) a comprehensive problem formulation and efficient fitness-based sorting algorithm to select the most valuable data to display at the application layer. We implement a proof-of-concept prototype of AICP with a bandwidth-hungry, latency-constrained real-life augmented reality application. The prototype adds only 12.6 milliseconds of latency to a current informativeness-unaware system. Next, we test the networking performance of AICP at scale and show that ACIP effectively filters out less relevant packets and decreases the channel busy time.
CYMar 3, 2020
Marketplace for AI ModelsAbhishek Kumar, Benjamin Finley, Tristan Braud et al.
Artificial intelligence shows promise for solving many practical societal problems in areas such as healthcare and transportation. However, the current mechanisms for AI model diffusion such as Github code repositories, academic project webpages, and commercial AI marketplaces have some limitations; for example, a lack of monetization methods, model traceability, and model auditabilty. In this work, we sketch guidelines for a new AI diffusion method based on a decentralized online marketplace. We consider the technical, economic, and regulatory aspects of such a marketplace including a discussion of solutions for problems in these areas. Finally, we include a comparative analysis of several current AI marketplaces that are already available or in development. We find that most of these marketplaces are centralized commercial marketplaces with relatively few models.
HCSep 11, 2018
Multidevice mobile sessions: A first lookBenjamin Finley, Tapio Soikkeli
The increasing number of users with multiple mobile devices underscores the importance of understanding how users interact, often simultaneously, with these multiple devices. However, most device based monitoring studies have focused only on a single device type. In contrast, we study the multidevice usage of a US-based panel through device based monitoring on panelist's smartphone and tablet devices. We present a broad range of results from characterizing individual multidevice sessions to estimating device usage substitution. For example, we find that for panelists, 50% of all device interaction time can be considered multidevice usage.
HCMar 24, 2018
Mobile Device Type SubstitutionBenjamin Finley, Tapio Soikkeli
Mobile users today interact with a variety of mobile device types including smartphones, tablets, smartwatches, and others. However research on mobile device type substitution has been limited in several respects including a lack of detailed and robust analyses. Therefore, in this work we study mobile device type substitution through analysis of multidevice usage data from a large US-based user panel. Specifically, we use regression analysis over paired user groups to test five device type substitution hypotheses. We find that both tablets and PCs are partial substitutes for smartphones with tablet and PC ownership decreasing smartphone usage by about 12.5 and 13 hours/month respectively. Additionally, we find that tablets and PCs also prompt about 20 and 57 hours/month respectively of additional (non-substituted) usage. We also illustrate significant inter-user diversity in substituted and additional usage. Overall, our results can help in understanding the relative positioning of different mobile device types and in parameterizing higher level mobile ecosystem models.
NIMay 3, 2017
Benefits of Mobile End User Network Switching and MultihomingBenjamin Finley, Arturo Basaure
Mobile users have not been able to exploit spatio-temporal differences between individual mobile networks operators for a variety of reasons. End user network switching and multihoming are two promising mechanisms that could allow such exploitation. However these mechanisms have not been thoroughly explored at a general system level with QoE metrics. Therefore, in this work we analyze these mechanisms in a variety of diverse scenarios through a system level model based on an agent based modeling framework. In terms of results, we find that in all scenarios end user network switching provides significant benefits in terms of both throughput and mean opinion score as the number of available networks increases. However, contrastingly, end user multihoming in most scenarios does not provide significant benefits over network switching given the same number of available networks. The major reason is inefficient radio resource allocation resulting from individual networks not taking the multihoming nature of end users into account. Though, in low user density situations this inefficiency is not a problem and multihoming does provide increased throughput though not increased mean opinion scores. Finally, scenarios that vary the fraction of users adopting multihoming suggests that both early and late adopters will have similar gains over users not adopting multihoming. Thus the adoption dynamics of multihoming appear favorable. Overall, the results support the applicability of end user network switching for improving mobile user experience and the applicability of end user multihoming in more limited situations.