Jannis Strecker-Bischoff
Last Name
Strecker-Bischoff
First name
Jannis
Email
jannis.strecker-bischoff@unisg.ch
ORCID
Phone
+41 71 224 27 63
8 results
Now showing 1 - 8 of 8
- Some of the metrics are blocked by yourconsent settings
Item type:Publication, Personalized Recommendations in Mixed Reality Enhance Explanation Satisfaction and Hedonic User Experience in Board Game Learning(Association for Computing Machinery, 2026-03-23); ; Board games often involve strategic decision making and procedural planning tasks. Such tasks require learners to make decisions based on dynamically evolving game state and changing information that is situated in a physical environment. Recommender systems can filter available information and provide learners with personalized and actionable suggestions that simplify their decision making while playing board games. Such recommendations can further be spatially aligned with relevant physical elements through Mixed Reality (MR). We present an MR system called GLAMRec for an engine-building strategy board game. GLAMRec provides personalized, transparent recommendations by integrating user data, real-time game state tracking, and ontology-based reasoning during a complex board game, which we use as a proxy environment for procedural learning tasks. We interviewed six board game designers to improve the GLAMRec and conducted a within-subjects design user study (N=32) to investigate how personalized explanations affect explanation satisfaction, user experience, and trust. We found that personalized recommendations significantly improve explanation satisfaction and hedonic user experience without affecting trust ratings, recommendation compliance, and game performance. These findings suggest that personalization primarily shaped perception of enjoyment rather than measurable learning outcomes or trust.Type:conference paperScopus© Citations 1 - Some of the metrics are blocked by yourconsent settings
Item type:Publication, ClearSkies: A Preliminary Study of Gaze-Mapped Scene Segmentation in Training Aircraft Cockpits(2026-06-01); ; In pilot training, deviation from standard procedures is a significant concern. To provide student pilots with objective feedback in postflight debriefing, we captured pilots’ view and gaze with the Pupil Core eye-tracker. Then we conducted a preliminary evaluation to test the feasibility of existing scene segmentation models for gazemapping1. We used an OpenCV baseline model for coarse inside vs. outside-analysis, a fine-tuned Detectron2 model for specific instrument segmentation, and Segment Anything Models (SAM 2 and SAM 3) for human-in-the-loop analysis. The baseline was fast but fragile, failing in common flight scenarios; the Detectron2 model was powerful but inflexible and unsuitable for general use; and SAM 3 was promising, offering generalizability for post-flight analysis despite noisy digital displays. A qualitative preliminary evaluation of SAM with Visual Flight Rules shows that it can be beneficial in eye movement analysis. We identified poor data quality in bright cockpit environments and ergonomics as main limitations.Type:conference paper - Some of the metrics are blocked by yourconsent settings
Item type:Publication, Towards Societally Beneficial Personalized Realities: A Conceptual Foundation for Responsible Ubiquitous Personalization SystemsPersonalization of online realities is today ubiquitous to support decision making or reduce information overload. Recently, through the expanding capabilities and pervasiveness of Mixed Reality and Ubiquitous Computing technologies, we observe increasing personalization also of physical reality. This might yield more convenient, efficient and inclusive everyday interactions. However, it may readily lead to serious societal consequences such as the loss of shared worlds and the emergence of perceptual filter bubbles. To mitigate such harms while retaining the benefits of personalization, it is important to understand how ubiquitous personalization systems may operate responsibly. Responding to this need, we propose a conceptual model that overcomes the limitations of established personalization models and expands their applicable scope to physical, virtual, and hybrid environments. We validated our model in relation to existing literature and show how it provides a conceptual foundation for the analysis and study of responsible personalization systems that create individually and societally beneficial Personalized Realities.Type:conference paperScopus© Citations 8 - Some of the metrics are blocked by yourconsent settings
Item type:Publication, Ad-Blocked Reality: Evaluating User Perceptions of Content Blocking Concepts Using Extended Reality(Association for Computing Machinery, 2025-04-26); Scopus© Citations 14 - Some of the metrics are blocked by yourconsent settings
Item type:Publication, Measuring Computational Thinking - Developing A Short Performance Test For Higher Education(2024-10-26); ; ; ; Technological advancements, particularly in artificial intelligence, significantly transform our society and work practices. Computational thinking (CT) has emerged as a crucial 21st-century skill, enabling individuals to solve problems more effectively through an automation-oriented perspective and fundamental concepts of computer science. To ensure the effective integration of CT into educational curricula, it is crucial to develop efficient assessment frameworks that allow teachers to measure and promote student CT proficiency. Therefore, our aim is to develop a short test to measure CT among undergraduate students. To this end, we consider two performance tests: the Computational Thinking test (CTt) and the Algorithmic Thinking Test for Adults (ATTA). We use items from both instruments to compile a short test. Based on a sample of 290 second-year non-computer science undergraduate students, we provide evidence on the quality of our test. Besides classical test theory, we apply item response theory, namely Rasch modeling, and confirmatory factor analysis. Our test shows favorable properties, e.g., Cronbach's alpha > .75, and may be suitable for the efficient assessment of CT across higher education programs.Type:conference paper - Some of the metrics are blocked by yourconsent settings
Item type:Publication, GEAR: Gaze-enabled augmented reality for human activity recognition(ACM, 2023-05-30); ; ; ; Hermann, JonasHead-mounted Augmented Reality (AR) displays overlay digital information on physical objects. Through eye tracking, they allow novel interaction methods and provide insights into user attention, intentions, and activities. However, only few studies have used gaze-enabled AR displays for human activity recognition (HAR). In an experimental study, we collected gaze data from 10 users on a HoloLens 2 (HL2) while they performed three activities (i.e., read, inspect, search). We trained machine learning models (SVM, Random Forest, Extremely Randomized Trees) with extracted features and achieved an up to 98.7% activity-recognition accuracy. On the HL2, we provided users with an AR feedback that is relevant to their current activity. We present the components of our system (GEAR) including a novel solution to enable the controlled sharing of collected data. We provide the scripts and anonymized datasets which can be used as teaching material in graduate courses or for reproducing our findings.Type:conference paperScopus© Citations 18 - Some of the metrics are blocked by yourconsent settings
Item type:Publication, EToS-1: Eye Tracking on Shopfloors for User Engagement with Automation(CEUR Workshop Proceedings, 2022-04-30); ; ; Stolze, MarkusMixed Reality (MR) is becoming an integral part of many context-aware industrial applications. In maintenance and remote support operations, the individual steps of computer-supported (cooperative) work can be defined and presented to human operators through MR headsets. Tracking of eye movements can provide valuable insights into a user’s decision-making and interaction processes. Thus, our overarching goal is to better understand the visual inspection behavior of machine operators on shopfloors and to find ways to provide them with attention-aware and context-aware assistance through MR headsets that increasingly come with eye tracking (ET) as a default feature. Toward this goal, in two industrial scenarios, we used two mobile eye tracking devices and systematically compared the visual inspection behavior of novice and expert operators. In this paper we present our preliminary findings and lessons learned.Type:conference paper - Some of the metrics are blocked by yourconsent settings
Item type:Publication, SOCRAR: Semantic OCR through Augmented Reality(ACM, 2022-11-11); ; ; ; To enable people to interact more efficiently with virtual and physical services in their surroundings, it would be beneficial if information could more fluently be passed across digital and non-digital spaces. To this end, we propose to combine semantic technologies with Optical Character Recognition on an Augmented Reality (AR) interface to enable the semantic integration of (written) information located in our everyday environments with Internet of Things devices. We hence present SOCRAR, a system that is able to detect written information from a user’s physical environment while contextualizing this data through a semantic backend. The SOCRAR system enables in-band semantic translation on an AR interface, permits semantic filtering and selection of appropriate device interfaces, and provides cognitive offloading by enabling users to store information for later use. We demonstrate the feasibility of SOCRAR through the implementation of three concrete scenarios.Type:conference paperJournal:Proceedings of the 12th International Conference on the Internet of ThingsScopus© Citations 13