Repository logo
  • English
  • Deutsch
  • Log In
    or
Repository logo
  • Research Outputs
  • Projects
  • People
  • Statistics
  • English
  • Deutsch
  • Log In
    or
  1. Home
  2. HSG CRIS
  3. HSG Publications
  4. GEAR: Gaze-enabled augmented reality for human activity recognition
 
Options

GEAR: Gaze-enabled augmented reality for human activity recognition

Type
conference paper
Date Issued
2023-05-30
Author(s)
Bektas, Kenan orcid-logo
Strecker, Jannis Rene orcid-logo
Mayer, Simon orcid-logo
Garcia, Kimberly
Hermann, Jonas
Jenss, Kay Erik
Antille, Yasmine Sheila orcid-logo
Soler, Marc Elias
DOI
https://doi.org/10.1145/3588015.3588402
Abstract
Head-mounted Augmented Reality (AR) displays overlay digital information on physical objects. Through eye tracking, they allow novel interaction methods and provide insights into user attention, intentions, and activities. However, only few studies have used gaze-enabled AR displays for human activity recognition (HAR). In an experimental study, we collected gaze data from 10 users on a HoloLens 2 (HL2) while they performed three activities (i.e., read, inspect, search). We trained machine learning models (SVM, Random Forest, Extremely Randomized Trees) with extracted features and achieved an up to 98.7% activity-recognition accuracy. On the HL2, we provided users with an AR feedback that is relevant to their current activity. We present the components of our system (GEAR) including a novel solution to enable the controlled sharing of collected data. We provide the scripts and anonymized datasets which can be used as teaching material in graduate courses or for reproducing our findings.
Project(s)
Mixed-Reality Support for Context-Aware and Autonomous Industrial Processes
Language
English
Keywords
pervasive eye tracking
augmented reality
attention
context-awareness
human activity recognition
eye tracking
HSG Classification
contribution to scientific community
Publisher
ACM
Publisher place
New York, NY, USA
Pages
9
Event Title
2023 ACM Symposium on Eye Tracking Research & Applications (ETRA'23)
Event Location
Tübingen, Germany
Event Date
May 30 – June 02, 2023
URL
https://www.alexandria.unisg.ch/handle/20.500.14171/107618
Subject(s)
  • computer science

  • education

  • behavioral science

Division(s)
  • ICS - Institute of Co...

Contact Email Address
kenan.bektas@unisg.ch
Eprints ID
269706
File(s)
PAPER_bektasetal_etra23.pdf (2.84 MB) POSTER_bektasetal_etra23.pdf (668.55 KB)
here you can find instructions

Built with DSpace-CRIS software - Extension maintained and optimized by 4Science

  • Cookie settings
  • Privacy policy
  • End User Agreement
  • Send Feedback