Repository logo
  • English
  • Deutsch
Log In
or
  1. Home
  2. HSG CRIS
  3. HSG Publications
  4. InterFACE: Establishing a Facial Action Unit Input Vocabulary for Hands-Free Extended Reality Interactions, From VR Gaming to AR Web Browsing
 
  • Details

InterFACE: Establishing a Facial Action Unit Input Vocabulary for Hands-Free Extended Reality Interactions, From VR Gaming to AR Web Browsing

Journal
CHI Conference on Human Factors in Computing Systems (CHI ’25)
Type
conference paper
Date Issued
2025-04
Author(s)
Wilson, Graham
Mccready, Jamie
Freeman, Euan
Florian Mathis  
Mcgill, Mark
Editor(s)
ACM
DOI
10.1145/3706598.3713694
Abstract
Extended Reality (XR) interactions often rely on spatial hand or controller inputs - necessitating dexterous wrist, hand and finger movements including pressing virtual buttons, pinching to select, and performing hand gestures. However, there are scenarios where such dependencies may render XR devices and apps inaccessible to users - from situational/temporary impairments such as encumbrance, to physical motor impairments. In this paper, we contribute to a growing literature considering facial input as an alternative. In a user study (N=20) we systematically evaluate the usability of 53 Facial Action Units in VR, deriving a set of optimal (comfort, effort, performance) FAUs for interaction. We then use these facial inputs to drive and evaluate (N=10) two demonstrator apps: VR locomotion, and AR web browsing, showcasing how close facial interaction can get to existing baselines, and demonstrating that FAUs offer a viable, generalizable input modality for XR devices.
Language
English
Keywords
Virtual Reality
Facial Action Units
Face
Interaction
Impairment
HSG Classification
contribution to scientific community
Refereed
Yes
Publisher
Association for Computing Machinery
Event Title
CHI 2025
Event Location
Yokohama, Japan
URL
https://www.alexandria.unisg.ch/handle/20.500.14171/121983
Subject(s)

computer science

Division(s)

ICS - Institute of Co...

SCS - School of Compu...

File(s)
Loading...
Thumbnail Image

open.access

Name

CHI2025_preprint_FAUs.pdf

Size

4.68 MB

Format

Adobe PDF

Checksum (MD5)

2414b76c0b44264b5b88f1ed9a08d4e1

here you can find instructions and news.

Built with DSpace-CRIS software - Extension maintained and optimized by 4Science

  • Privacy policy
  • End User Agreement
  • Send Feedback