Language, Action and Perception

Simon Dobnik (University of Gothenburg, Sweden) and John Kelleher (Dublin Institute of Technology, Ireland)

The course gives a survey of theory and practical computational implementations of how natural language interacts with the physical world through action and perception. We will look at topics such as semantic theories and computational approaches to modelling natural language, action and perception (grounding), situated dialogue systems, integrated robotic systems, grounding of language in action and perception, generation and interpretation of scene descriptions from images and videos, spatial cognition, and others.

Course Materials