Michael Schaffer

2papers

2 Papers

AIAug 8, 2023
Adding Why to What? Analyses of an Everyday Explanation

Lutz Terfloth, Michael Schaffer, Heike M. Buhl et al.

In XAI it is important to consider that, in contrast to explanations for professional audiences, one cannot assume common expertise when explaining for laypeople. But such explanations between humans vary greatly, making it difficult to research commonalities across explanations. We used the dual nature theory, a techno-philosophical approach, to cope with these challenges. According to it, one can explain, for example, an XAI's decision by addressing its dual nature: by focusing on the Architecture (e.g., the logic of its algorithms) or the Relevance (e.g., the severity of a decision, the implications of a recommendation). We investigated 20 game explanations using the theory as an analytical framework. We elaborate how we used the theory to quickly structure and compare explanations of technological artifacts. We supplemented results from analyzing the explanation contents with results from a video recall to explore how explainers justified their explanation. We found that explainers were focusing on the physical aspects of the game first (Architecture) and only later on aspects of the Relevance. Reasoning in the video recalls indicated that EX regarded the focus on the Architecture as important for structuring the explanation initially by explaining the basic components before focusing on more complex, intangible aspects. Shifting between addressing the two sides was justified by explanation goals, emerging misunderstandings, and the knowledge needs of the explainee. We discovered several commonalities that inspire future research questions which, if further generalizable, provide first ideas for the construction of synthetic explanations.

9.6OHMar 25
Bridging the Dual Nature: How Integrated Explanations Enhance Understanding of Technical Artifacts

Lutz Terfloth, Heike M. Buhl, Vivien Lohmer et al.

Purpose: Understanding a technical artifact requires grasping both its internal structure (Architecture) and its purpose and significance (Relevance), as formalized by Dual Nature Theory. This controlled experimental study investigates whether how explainers address these perspectives affects explainees' understanding. Methods: In a between-subjects experiment, 104 participants received explanations of the board game Quarto! from trained confederates in one of three conditions: Architecture-focused (A), Relevance-focused (R), or Integrated (AR). Understanding was assessed on comprehension (knowing that) and enabledness (knowing how). Results: The A and R conditions produced equivalent understanding despite different explanation content. The AR condition yielded significantly higher enabledness than the focused conditions combined $\mathrm{F}(1, 102) = 4.83$, $p = .030$, $η^2_p = .045$}, while no differences emerged for comprehension. Conclusion: Integrating Architecture and Relevance specifically enhances explainees' ability to apply their understanding in practice, suggesting that fostering agency with technical artifacts requires bridging both perspectives. This has implications for technology education and explainable AI design.