University of St.Gallen
research platform alexandria
search publications
browse publications
by person
A B C D E F G H I J K L M N O P Q R S T U V W X Y Z
 
by year

How Spatial Information Connects Visual Perception and Natural Language Generation in Dynamic Environments: Towards a Computational Model

abstract Suppose that you are required to describe a route step-by-step to somebody who does not know the environment. A major question in this context is what kind of spatial information must be integrated in a route description. This task generally refers to two cognitive abilities: Visual perception and natural language. In this domain, a computational model for the generation of incremental route descriptions is presented. Central to this model is a distinction into a visual, a linguistic, and a conceptual-spatial level. Basing on these different levels a software agent, called MOSES, is introduced who moves through a simulated 3D environment from a starting-point to a destination. He selects visuo-spatial information and generates appropriate route descriptions. It is shown how MOSES adopts his linguistic behavior to spatial and temporal constraints. The generation process is based on a corpus of incremental route descriptions which were collected by field experiments. The agent and the 3D environment are entirely implemented.
   
type conference paper (English)
   
keywords
   
project VITRA: Visual Translator
name of conference Spatial Information Theory: A Theoretical Basis for GIS (Proc. of the Int. Conference COSIT'95)
date of conference 1-1-1995
review external review
   
citation Maass, W. (1995). How Spatial Information Connects Visual Perception and Natural Language Generation in Dynamic Environments: Towards a Computational Model. In .