Now showing 1 - 6 of 6
No Thumbnail Available
Publication

HyperBrain: Human-inspired Hypermedia Guidance using a Large Language Model

2023-09-05 , Vachtsevanou, Danai , Lemee, Jérémy , Rot, Raffael , Mayer, Simon , Ciortea, Andrei , Ramanathan, Ganesh

We present HyperBrain, a hypermedia client that autonomously navigates hypermedia environments to achieve user goals specified in natural language. To achieve this, the client makes use of a large language model to decide which of the available hypermedia controls should be used within a given application context. In a demonstrative scenario, we show the client's ability to autonomously select and follow simple hyperlinks towards a high-level goal, successfully traversing the hypermedia structure of Wikipedia given only the markup of the respective resources. We show that hypermedia navigation based on language models is effective, and propose that this should be considered as a step to create hypermedia environments that are used by autonomous clients alongside people.

No Thumbnail Available
Publication

Semantic Knowledge for Autonomous Smart Farming

2022-09-14 , Ramanathan, Ganesh , Vachtsevanou, Danai , Garcia, Kimberly , Lemee, Jérémy , Burattini, Samuele , Bektas, Kenan , Mayer, Simon

No Thumbnail Available
Publication

SOCRAR: Semantic OCR through Augmented Reality

2022-11-11 , Strecker, Jannis Rene , Garcia, Kimberly , Bektas, Kenan , Mayer, Simon , Ramanathan, Ganesh

To enable people to interact more efficiently with virtual and physical services in their surroundings, it would be beneficial if information could more fluently be passed across digital and non-digital spaces. To this end, we propose to combine semantic technologies with Optical Character Recognition on an Augmented Reality (AR) interface to enable the semantic integration of (written) information located in our everyday environments with Internet of Things devices. We hence present SOCRAR, a system that is able to detect written information from a user’s physical environment while contextualizing this data through a semantic backend. The SOCRAR system enables in-band semantic translation on an AR interface, permits semantic filtering and selection of appropriate device interfaces, and provides cognitive offloading by enabling users to store information for later use. We demonstrate the feasibility of SOCRAR through the implementation of three concrete scenarios.

No Thumbnail Available
Publication

Interoperability vs. Tradition: Benefits and Challenges of Web of Things in Building Automation

2021-11-08 , Ramanathan, Ganesh , Husmann, Maria , Mayer, Simon

No Thumbnail Available
Publication

Semantic Data Integration with DevOps to Support Engineering Process of Intelligent Building Automation Systems

2021-11-17 , Mizutani, Iori , Ramanathan, Ganesh , Mayer, Simon

No Thumbnail Available
Publication

Adaptable Room Automation Using Multi-agent System

2021 , Ramanathan, Ganesh