Peter Kieseberg

AI
5papers
184citations
Novelty28%
AI Score37

5 Papers

18.2SEMay 23
Beyond AI Delegation: A Prompt Pattern Framework for Productive Struggle and Evaluative Judgement in Secure Coding Education

Philipp Haindl, Oliver Eigner, Peter Kieseberg

Large language models make it easy for students to delegate writing, analysis, and problem-solving to automated systems, bypassing the effortful engagement that produces lasting understanding. We introduce a practical framework that helps educators keep GenAI in the course without removing the cognitive demands that make it worthwhile. We apply Design Science Research (DSR) to synthesise and adapt a taxonomy of nine prompt engineering patterns from established catalogs in the computer science literature, mapped to two pedagogical constructs: Productive Struggle and Evaluative Judgement. A course design for an Advanced Secure Coding module, structured using the DELTA framework, demonstrates the artifact's applicability. Nine prompt patterns, each mapped to a specific pedagogical function, give instructors fine-grained control over how students interact with AI. The secure coding design shows how three patterns (Flipped Interaction, Alternative Approaches, and Cognitive Verifier) scaffold vulnerability discovery and remediation while keeping students in the reasoning role. The framework provides a replicable approach to designing AI-augmented learning experiences that preserve student reasoning, and establishes a structured basis for future empirical evaluation in live course settings.

LGSep 18, 2021
Towards Resilient Artificial Intelligence: Survey and Research Issues

Oliver Eigner, Sebastian Eresheim, Peter Kieseberg et al.

Artificial intelligence (AI) systems are becoming critical components of today's IT landscapes. Their resilience against attacks and other environmental influences needs to be ensured just like for other IT assets. Considering the particular nature of AI, and machine learning (ML) in particular, this paper provides an overview of the emerging field of resilient AI and presents research issues the authors identify as potential future work.

LGFeb 9, 2021
$k$-Anonymity in Practice: How Generalisation and Suppression Affect Machine Learning Classifiers

Djordje Slijepčević, Maximilian Henzl, Lukas Daniel Klausner et al.

The protection of private information is a crucial issue in data-driven research and business contexts. Typically, techniques like anonymisation or (selective) deletion are introduced in order to allow data sharing, e. g. in the case of collaborative research endeavours. For use with anonymisation techniques, the $k$-anonymity criterion is one of the most popular, with numerous scientific publications on different algorithms and metrics. Anonymisation techniques often require changing the data and thus necessarily affect the results of machine learning models trained on the underlying data. In this work, we conduct a systematic comparison and detailed investigation into the effects of different $k$-anonymisation algorithms on the results of machine learning models. We investigate a set of popular $k$-anonymisation algorithms with different classifiers and evaluate them on different real-world datasets. Our systematic evaluation shows that with an increasingly strong $k$-anonymity constraint, the classification performance generally degrades, but to varying degrees and strongly depending on the dataset and anonymisation method. Furthermore, Mondrian can be considered as the method with the most appealing properties for subsequent classification.

AIFeb 11, 2018
The Need for Speed of AI Applications: Performance Comparison of Native vs. Browser-based Algorithm Implementations

Bernd Malle, Nicola Giuliani, Peter Kieseberg et al.

AI applications pose increasing demands on performance, so it is not surprising that the era of client-side distributed software is becoming important. On top of many AI applications already using mobile hardware, and even browsers for computationally demanding AI applications, we are already witnessing the emergence of client-side (federated) machine learning algorithms, driven by the interests of large corporations and startups alike. Apart from mathematical and algorithmic concerns, this trend especially demands new levels of computational efficiency from client environments. Consequently, this paper deals with the question of state-of-the-art performance by presenting a comparison study between native code and different browser-based implementations: JavaScript, ASM.js as well as WebAssembly on a representative mix of algorithms. Our results show that current efforts in runtime optimization push the boundaries well towards (and even beyond) native binary performance. We analyze the results obtained and speculate on the reasons behind some surprises, rounding the paper off by outlining future possibilities as well as some of our own research efforts.

AIDec 18, 2017
Towards the Augmented Pathologist: Challenges of Explainable-AI in Digital Pathology

Andreas Holzinger, Bernd Malle, Peter Kieseberg et al.

Digital pathology is not only one of the most promising fields of diagnostic medicine, but at the same time a hot topic for fundamental research. Digital pathology is not just the transfer of histopathological slides into digital representations. The combination of different data sources (images, patient records, and *omics data) together with current advances in artificial intelligence/machine learning enable to make novel information accessible and quantifiable to a human expert, which is not yet available and not exploited in current medical settings. The grand goal is to reach a level of usable intelligence to understand the data in the context of an application task, thereby making machine decisions transparent, interpretable and explainable. The foundation of such an "augmented pathologist" needs an integrated approach: While machine learning algorithms require many thousands of training examples, a human expert is often confronted with only a few data points. Interestingly, humans can learn from such few examples and are able to instantly interpret complex patterns. Consequently, the grand goal is to combine the possibilities of artificial intelligence with human intelligence and to find a well-suited balance between them to enable what neither of them could do on their own. This can raise the quality of education, diagnosis, prognosis and prediction of cancer and other diseases. In this paper we describe some (incomplete) research issues which we believe should be addressed in an integrated and concerted effort for paving the way towards the augmented pathologist.