5.9ROApr 3
Do Robots Need Body Language? Comparing Communication Modalities for Legible Motion Intent in Human-Shared SpacesJonathan Albert Cohen, Kye Shimizu, Allen Song et al.
Robots in shared spaces often move in ways that are difficult for people to interpret, placing the burden on humans to adapt. High-DoF robots exhibit motion that people read as expressive, intentionally or not, making it important to understand how such cues are perceived. We present an online video study evaluating how different signaling modalities, expressive motion, lights, text, and audio, shape people's ability to understand a quadruped robot's upcoming navigation actions (Boston Dynamics Spot). Across four common scenarios, we measure how each modality influences humans' (1) accuracy in predicting the robot's next navigation action, (2) confidence in that prediction, and (3) trust in the robot to act safely. The study tests how expressive motions compare to explicit channels, whether aligned multimodal cues enhance interpretability, and how conflicting cues affect user confidence and trust. We contribute initial evidence on the relative effectiveness of implicit versus explicit signaling strategies.
QUANT-PHJan 31, 2023
Fourier series weight in quantum machine learningParfait Atchade-Adelomou, Kent Larson
In this work, we aim to confirm the impact of the Fourier series on the quantum machine learning model. We will propose models, tests, and demonstrations to achieve this objective. We designed a quantum machine learning leveraged on the Hamiltonian encoding. With a subtle change, we performed the trigonometric interpolation, binary and multiclass classifier, and a quantum signal processing application. We also proposed a block diagram of determining approximately the Fourier coefficient based on quantum machine learning. We performed and tested all the proposed models using the Pennylane framework.
AIOct 16, 2025Code
HugAgent: Benchmarking LLMs for Simulation of Individualized Human ReasoningChance Jiajie Li, Zhenze Mo, Yuhan Tang et al.
Simulating human reasoning in open-ended tasks has long been a central aspiration in AI and cognitive science. While large language models now approximate human responses at scale, they remain tuned to population-level consensus, often erasing the individuality of reasoning styles and belief trajectories. To advance the vision of more human-like reasoning in machines, we introduce HugAgent (Human-Grounded Agent Benchmark), which rethinks human reasoning simulation along three dimensions: (i) from averaged to individualized reasoning, (ii) from behavioral mimicry to cognitive alignment, and (iii) from vignette-based to open-ended data. The benchmark evaluates whether a model can predict a specific person's behavioral responses and the underlying reasoning dynamics in out-of-distribution scenarios, given partial evidence of their prior views. HugAgent adopts a dual-track design: a human track that automates and scales the think-aloud method to collect ecologically valid human reasoning data, and a synthetic track for further scalability and systematic stress testing. This architecture enables low-cost, extensible expansion to new tasks and populations. Experiments with state-of-the-art language models reveal persistent adaptation gaps, positioning HugAgent as the first extensible benchmark for aligning machine reasoning with the individuality of human thought. The benchmark, along with its complete data collection pipeline and companion chatbot, is open-sourced as HugAgent (https://anonymous.4open.science/r/HugAgent) and TraceYourThinking (https://anonymous.4open.science/r/trace-your-thinking).
AIDec 25, 2024
TravelAgent: Generative Agents in the Built EnvironmentAriel Noyman, Kai Hu, Kent Larson
Understanding human behavior in built environments is critical for designing functional, user centered urban spaces. Traditional approaches, such as manual observations, surveys, and simplified simulations, often fail to capture the complexity and dynamics of real world behavior. To address these limitations, we introduce TravelAgent, a novel simulation platform that models pedestrian navigation and activity patterns across diverse indoor and outdoor environments under varying contextual and environmental conditions. TravelAgent leverages generative agents integrated into 3D virtual environments, enabling agents to process multimodal sensory inputs and exhibit human-like decision-making, behavior, and adaptation. Through experiments, including navigation, wayfinding, and free exploration, we analyze data from 100 simulations comprising 1898 agent steps across diverse spatial layouts and agent archetypes, achieving an overall task completion rate of 76%. Using spatial, linguistic, and sentiment analyses, we show how agents perceive, adapt to, or struggle with their surroundings and assigned tasks. Our findings highlight the potential of TravelAgent as a tool for urban design, spatial cognition research, and agent-based modeling. We discuss key challenges and opportunities in deploying generative agents for the evaluation and refinement of spatial designs, proposing TravelAgent as a new paradigm for simulating and understanding human experiences in built environments.
LGFeb 23, 2024
TransFlower: An Explainable Transformer-Based Model with Flow-to-Flow Attention for Commuting Flow PredictionYan Luo, Zhuoyue Wan, Yuzhong Chen et al.
Understanding the link between urban planning and commuting flows is crucial for guiding urban development and policymaking. This research, bridging computer science and urban studies, addresses the challenge of integrating these fields with their distinct focuses. Traditional urban studies methods, like the gravity and radiation models, often underperform in complex scenarios due to their limited handling of multiple variables and reliance on overly simplistic and unrealistic assumptions, such as spatial isotropy. While deep learning models offer improved accuracy, their black-box nature poses a trade-off between performance and explainability -- both vital for analyzing complex societal phenomena like commuting flows. To address this, we introduce TransFlower, an explainable, transformer-based model employing flow-to-flow attention to predict urban commuting patterns. It features a geospatial encoder with an anisotropy-aware relative location encoder for nuanced flow representation. Following this, the transformer-based flow predictor enhances this by leveraging attention mechanisms to efficiently capture flow interactions. Our model outperforms existing methods by up to 30.8% Common Part of Commuters, offering insights into mobility dynamics crucial for urban planning and policy decisions.
AIMay 5, 2025
Perspective-Aware AI in Extended RealityDaniel Platnick, Matti Gruener, Marjan Alirezaie et al.
AI-enhanced Extended Reality (XR) aims to deliver adaptive, immersive experiences-yet current systems fall short due to shallow user modeling and limited cognitive context. We introduce Perspective-Aware AI in Extended Reality (PAiR), a foundational framework for integrating Perspective-Aware AI (PAi) with XR to enable interpretable, context-aware experiences grounded in user identity. PAi is built on Chronicles: reasoning-ready identity models learned from multimodal digital footprints that capture users' cognitive and experiential evolution. PAiR employs these models in a closed-loop system linking dynamic user states with immersive environments. We present PAiR's architecture, detailing its modules and system flow, and demonstrate its utility through two proof-of-concept scenarios implemented in the Unity-based OpenDome engine. PAiR opens a new direction for human-AI interaction by embedding perspective-based identity models into immersive systems.
AIAug 22, 2025
Graph RAG as Human Choice Model: Building a Data-Driven Mobility Agent with Preference ChainKai Hu, Parfait Atchade-Adelomou, Carlo Adornetto et al.
Understanding human behavior in urban environments is a crucial field within city sciences. However, collecting accurate behavioral data, particularly in newly developed areas, poses significant challenges. Recent advances in generative agents, powered by Large Language Models (LLMs), have shown promise in simulating human behaviors without relying on extensive datasets. Nevertheless, these methods often struggle with generating consistent, context-sensitive, and realistic behavioral outputs. To address these limitations, this paper introduces the Preference Chain, a novel method that integrates Graph Retrieval-Augmented Generation (RAG) with LLMs to enhance context-aware simulation of human behavior in transportation systems. Experiments conducted on the Replica dataset demonstrate that the Preference Chain outperforms standard LLM in aligning with real-world transportation mode choices. The development of the Mobility Agent highlights potential applications of proposed method in urban mobility modeling for emerging cities, personalized travel behavior analysis, and dynamic traffic forecasting. Despite limitations such as slow inference and the risk of hallucination, the method offers a promising framework for simulating complex human behavior in data-scarce environments, where traditional data-driven models struggle due to limited data availability.
CYJun 8, 2025
Simulating Society Requires Simulating ThoughtChance Jiajie Li, Jiayi Wu, Zhenze Mo et al.
Simulating society with large language models (LLMs), we argue, requires more than generating plausible behavior; it demands cognitively grounded reasoning that is structured, revisable, and traceable. LLM-based agents are increasingly used to emulate individual and group behavior, primarily through prompting and supervised fine-tuning. Yet current simulations remain grounded in a behaviorist "demographics in, behavior out" paradigm, focusing on surface-level plausibility. As a result, they often lack internal coherence, causal reasoning, and belief traceability, making them unreliable for modeling how people reason, deliberate, and respond to interventions. To address this, we present a conceptual modeling paradigm, Generative Minds (GenMinds), which draws from cognitive science to support structured belief representations in generative agents. To evaluate such agents, we introduce the RECAP (REconstructing CAusal Paths) framework, a benchmark designed to assess reasoning fidelity via causal traceability, demographic grounding, and intervention consistency. These contributions advance a broader shift: from surface-level mimicry to generative agents that simulate thought, not just language, for social simulations.
LGJan 4, 2022
Generating synthetic mobility data for a realistic population with RNNs to improve utility and privacyAlex Berke, Ronan Doorley, Kent Larson et al.
Location data collected from mobile devices represent mobility behaviors at individual and societal levels. These data have important applications ranging from transportation planning to epidemic modeling. However, issues must be overcome to best serve these use cases: The data often represent a limited sample of the population and use of the data jeopardizes privacy. To address these issues, we present and evaluate a system for generating synthetic mobility data using a deep recurrent neural network (RNN) which is trained on real location data. The system takes a population distribution as input and generates mobility traces for a corresponding synthetic population. Related generative approaches have not solved the challenges of capturing both the patterns and variability in individuals' mobility behaviors over longer time periods, while also balancing the generation of realistic data with privacy. Our system leverages RNNs' ability to generate complex and novel sequences while retaining patterns from training data. Also, the model introduces randomness used to calibrate the variation between the synthetic and real data at the individual level. This is to both capture variability in human mobility, and protect user privacy. Location based services (LBS) data from more than 22,700 mobile devices were used in an experimental evaluation across utility and privacy metrics. We show the generated mobility data retain the characteristics of the real data, while varying from the real data at the individual level, and where this amount of variation matches the variation within the real data.
MAJun 15, 2021
Future urban mobility as a bio-inspired collaborative system of multi-functional autonomous vehiclesNaroa Coretti Sánchez, Juan Múgica González, Luis Alonso Pastor et al.
The fast urbanization and climate change challenges require solutions that enable the efficient movement of people and goods in cities. We envision future cities to be composed of high-performing walkable districts where transportation needs could be served by fleets of ultra-lightweight shared and autonomous vehicles. A future in which most vehicles would be autonomous creates a new paradigm for the possible interactions between vehicles. Natural swarms are a great example of how rich interactions can be; they can divide tasks, cluster, build together, or transport cooperatively. The field of swarm robotics has translated some of the behaviors from natural swarms to artificial systems, proving to make systems more flexible, scalable, and robust. Inspired by nature and supported by swarm robotics, this paper proposes a future mobility in which shared, electric, and autonomous vehicles would be multi-functional and behave as a collaborative system. In this future, fleets of multi-functional vehicles would complete different tasks collaboratively, giving a response to the different urban mobility needs. This paper contributes with the proposal of a framework for future urban mobility that integrates current research and mobility trends in a novel and unique way.
CRMar 31, 2020
Assessing Disease Exposure Risk with Location Data: A Proposal for Cryptographic Preservation of PrivacyAlex Berke, Michiel Bakker, Praneeth Vepakomma et al.
Governments and researchers around the world are implementing digital contact tracing solutions to stem the spread of infectious disease, namely COVID-19. Many of these solutions threaten individual rights and privacy. Our goal is to break past the false dichotomy of effective versus privacy-preserving contact tracing. We offer an alternative approach to assess and communicate users' risk of exposure to an infectious disease while preserving individual privacy. Our proposal uses recent GPS location histories, which are transformed and encrypted, and a private set intersection protocol to interface with a semi-trusted authority. There have been other recent proposals for privacy-preserving contact tracing, based on Bluetooth and decentralization, that could further eliminate the need for trust in authority. However, solutions with Bluetooth are currently limited to certain devices and contexts while decentralization adds complexity. The goal of this work is two-fold: we aim to propose a location-based system that is more privacy-preserving than what is currently being adopted by governments around the world, and that is also practical to implement with the immediacy needed to stem a viral outbreak.
HCJul 19, 2019
CityScopeAR: Urban Design and Crowdsourced Engagement PlatformAriel Noyman, Yasushi Sakai, Kent Larson
Processes of urban planning, urban design and architecture are inherently tangible, iterative and collaborative. Nevertheless, the majority of tools in these fields offer virtual environments and single user experience. This paper presents CityScopeAR: a computational-tangible mixed-reality platform designed for collaborative urban design processes. It portrays the evolution of the tool and presents an overview of the history and limitations of notable CAD and TUI platforms. As well, it depicts the development of a distributed networking system between TUIs and CityScopeAR, as a key in design collaboration. It shares the potential advantage of broad and decentralized community-engagement process using such tools. Finally, this paper demonstrates several real-world tests and deployments of CityScopeAR and proposes a path to future integration of AR/MR devices in urban design and public participation.
HCNov 26, 2018
Finding Places: HCI Platform for Public Participation in Refugees Accommodation ProcessAriel Noyman, Tobias Holtz, Johannes Kroger et al.
This paper describes the conception, development and deployment of a novel HCI system for public participation and decision making. This system was applied for the process of allocating refugee accommodation in the City of Hamburg within the FindingPlaces project in 2016. The CityScope a rapid prototyping platform for urban planning and decision making offered a technical solution which was complemented by a workshop process to facilitate effective interaction of multiple participants and stakeholder groups. This paper presents the origins of CS and the evolution of the tangible user interface approach to urban planning and public participation. It further outlines technical features of the system, including custom hardware and software in use, utilization in real time as well as technical constraints and limitations. Special focus is on the adaptation of the CS technology to the specific demands of Hamburg FP project, whose procedures, processes, and results are reflected. The final section analyzes success factors as well as shortcomings of the approach, and indicates further R&D as well as application scenarios for the CS.
ROOct 18, 2018
Urban Swarms: A new approach for autonomous waste managementAntonio Luca Alfeo, Eduardo Castelló Ferrer, Yago Lizarribar Carrillo et al.
Modern cities are growing ecosystems that face new challenges due to the increasing population demands. One of the many problems they face nowadays is waste management, which has become a pressing issue requiring new solutions. Swarm robotics systems have been attracting an increasing amount of attention in the past years and they are expected to become one of the main driving factors for innovation in the field of robotics. The research presented in this paper explores the feasibility of a swarm robotics system in an urban environment. By using bio-inspired foraging methods such as multi-place foraging and stigmergy-based navigation, a swarm of robots is able to improve the efficiency and autonomy of the urban waste management system in a realistic scenario. To achieve this, a diverse set of simulation experiments was conducted using real-world GIS data and implementing different garbage collection scenarios driven by robot swarms. Results presented in this research show that the proposed system outperforms current approaches. Moreover, results not only show the efficiency of our solution, but also give insights about how to design and customize these systems.