17.2HCJul 16Code
Supporting Multimodal Data Interaction on Refreshable Tactile Displays: An Architecture to Combine Touch and Conversational AISamuel Reinders, Munazza Zaib, Matthew Butler et al.
Combining conversational AI with refreshable tactile displays (RTDs) offers significant potential for creating accessible data visualization for people who are blind or have low vision (BLV). To support researchers and developers building accessible data visualizations with RTDs, we present a multimodal data interaction architecture along with an open-source reference implementation. Our system is the first to combine touch input with a conversational agent on an RTD, enabling deictic queries that fuse touch context with spoken language, such as "what is the trend between these points?" The architecture addresses key technical challenges, including touch sensing on RTDs, visual-to-tactile encoding, integrating touch context with conversational AI, and synchronizing multimodal output. Our contributions are twofold: (1) a technical architecture integrating RTD hardware, external touch sensing, and conversational AI to enable multimodal data interaction; and (2) an open-source reference implementation demonstrating its feasibility. This work provides a technical foundation to support future research in multimodal accessible data visualization.
5.4HCJul 16
Conversational Tactile Data Interfaces: Co-Designing Accessible Data Experiences with Blind Users Using Refreshable Tactile Displays and Conversational AISamuel Reinders, Munazza Zaib, Bongshin Lee et al.
Combining refreshable tactile displays (RTDs) with conversational AI offers a promising approach to accessible data visualization for people who are blind or have low vision (BLV). However, it remains an open question how these modalities should be integrated to support accessible data experiences. We address this through a co-design process with three BLV co-designers. Building on our prior Wizard-of-Oz study, we created a conversational tactile data interface (CTDI) that combines an RTD with an LLM-powered conversational agent, refined through four workshops over eight months. In addition to the resulting system, Graphy, we contribute design knowledge and recommendations for CTDIs. Co-designers used touch as the primary sensemaking channel for spatial understanding of the data's shape, trends, and relationships, reserved the agent for what touch could not resolve (e.g., calculation and analysis), and used the chart on the RTD to verify the agent's responses. Key findings include: a layered presentation that scaffolds chart exploration through progressive, interactive layers; a feedback grammar that distinguishes user- and agent-initiated tactile feedback; and a sequential interaction pattern -- select, confirm, ask, verify -- where each step grounds the last.
AIIM: Adaptive Inter-cell Interference Mitigation for Heterogeneous Multi-vendor 5G O-RAN NetworksSamuel Reinders, Alireza Ebrahimi Dorcheh, Ryan Barker et al.
Inter-cell interference is a persistent issue in dense 5G deployments, especially in heterogeneous Open Radio Access Network (O-RAN) environments where coordination between base stations is limited. This paper presents AIIM, an adaptive inter-cell interference mitigation xApp for the O-RAN near-real-time RAN Intelligent Controller (near-RT RIC) that performs coordinated physical resource block (PRB) allocation across multiple base stations under diverse traffic demands and channel conditions. Unlike prior studies that rely primarily on simulation or fully hardware-centric testbeds, AIIM is developed and evaluated in a full-stack O-RAN system built on srsRAN, Open5GS, and O-RAN Software Community (ORAN-SC), and deployed on a hybrid experimental platform that simultaneously combines software defined radio (SDR)-based and virtual gNodeBs (gNBs) and user equipment (UEs). This design preserves realistic PHY-layer interactions while substantially improving scalability, reproducibility, and cost-effectiveness for multi-cell interference experiments. AIIM explicitly models overlapping PRB regions across neighboring cells and learns coordinated allocation policies that adapt to per-user QoS demand and pathloss variation across the network. Experimental results show that AIIM improves QoS satisfaction and reduces interference-induced PRB loss relative to proportional-fair scheduling baselines while maintaining comparable aggregate network throughput. These results demonstrate the promise of scalable, learning-driven O-RAN control for practical interference management in heterogeneous multi-gNB 5G networks.\footnote{A video demonstration of the running system can be found at https://github.com/sireinders/AIIM-Multi-gNB-Interference.git.}
10.4HCFeb 2, 2021
Technology Developments in Touch-Based Accessible Graphics: A Systematic Review of Research 2010-2020Matthew Butler, Leona Holloway, Samuel Reinders et al.
This paper presents a systematic literature review of 292 publications from 97 unique venues on touch-based graphics for people who are blind or have low vision, from 2010 to mid-2020. It is the first review of its kind on touch-based accessible graphics. It is timely because it allows us to assess the impact of new technologies such as commodity 3D printing and low-cost electronics on the production and presentation of accessible graphics. As expected our review shows an increase in publications from 2014 that we can attribute to these developments. It also reveals the need to: broaden application areas, especially to the workplace; broaden end-user participation throughout the full design process; and conduct more in situ evaluation. This work is linked to an online living resource to be shared with the wider community.