SOCRAR: Semantic OCR through Augmented Reality

Item Type Conference or Workshop Item (Paper)
Abstract To enable people to interact more efficiently with virtual and physical services in their surroundings, it would be beneficial if information could more fluently be passed across digital and non-digital spaces. To this end, we propose to combine semantic technologies with Optical Character Recognition on an Augmented Reality (AR) interface to enable the semantic integration of (written) information located in our everyday environments with Internet of Things devices. We hence present SOCRAR, a system that is able to detect written information from a user’s physical environment while contextualizing this data through a semantic backend. The SOCRAR system enables in-band semantic translation on an AR interface, permits semantic filtering and selection of appropriate device interfaces, and provides cognitive offloading by enabling users to store information for later use. We demonstrate the feasibility of SOCRAR through the implementation of three concrete scenarios.
Authors Strecker, Jannis Rene; Garcia, Kimberly; Bektas, Kenan; Mayer, Simon & Ramanathan, Ganesh
Journal or Publication Title Proceedings of the 12th International Conference on the Internet of Things
Language English
Keywords Knowledge Graph, Web of Things, Ubiquitous Computing, Augmented Reality, Optical Character Recognition
Subjects computer science
HSG Classification contribution to scientific community
Refereed Yes
Date 11 November 2022
Publisher ACM
Place of Publication New York, NY, USA
Page Range 25-32
Event Title 12th International Conference on the Internet of Things (IoT ’22)
Event Location Delft, Netherlands
Event Dates November 7-10, 2022
ISBN 9781450396653
Publisher DOI https://doi.org/10.1145/3567445.3567453
Official URL https://dl.acm.org/doi/10.1145/3567445.3567453
Contact Email Address jannisrene.strecker@unisg.ch
Depositing User Prof. Dr. Simon Mayer
Date Deposited 20 Nov 2022 19:42
Last Modified 28 Feb 2023 12:41
URI: https://www.alexandria.unisg.ch/publications/267988

Download

[img] Text
Strecker2022-SOCRAR.pdf
Download (1MB)

Citation

Strecker, Jannis Rene; Garcia, Kimberly; Bektas, Kenan; Mayer, Simon & Ramanathan, Ganesh: SOCRAR: Semantic OCR through Augmented Reality. 2022. - 12th International Conference on the Internet of Things (IoT ’22). - Delft, Netherlands.

Statistics

https://www.alexandria.unisg.ch/id/eprint/267988
Edit item Edit item
Feedback?