Context shifts

Extending the meanings of physical objects with language

David R. McGee, Misha Pavel, Philip R. Cohen

Research output: Contribution to journalArticle

6 Citations (Scopus)

Abstract

The influence that language has on contextual interpretations cannot be ignored by computer systems that strive to be context aware. Rather, once systems are designed to perceive language and other forms of human action, these interpretative processes will of necessity be context dependent. As an example, we illustrate how people simply and naturally create new contexts by naming and referring. We then describe Rasa, a mixed-reality system that observes and understands how users in a military command post create such contexts as part of the process of maintaining situational awareness. In such environments, commander's maps are covered with Post-it® notes. These paper artifacts are contextually transformed to represent units in the field by the application of multimodal language. Rasa understands this language, thereby allowing paper-based tools to become the basis for digital interaction. Finally, we argue that architectures for such context-aware systems will need to be built to process the inherent ambiguity and uncertainty of human input in order to be effective.

Original languageEnglish (US)
Pages (from-to)351-362
Number of pages12
JournalHuman-Computer Interaction
Volume16
Issue number2-4
StatePublished - 2001
Externally publishedYes

Fingerprint

Computer systems
Language
Context-aware
Mixed Reality
Situational Awareness
Computer Systems
Artifacts
Military
Uncertainty
Unit
Object
Meaning
Context
Dependent
Interaction
Human

ASJC Scopus subject areas

  • Computational Theory and Mathematics
  • Human-Computer Interaction
  • Theoretical Computer Science

Cite this

McGee, D. R., Pavel, M., & Cohen, P. R. (2001). Context shifts: Extending the meanings of physical objects with language. Human-Computer Interaction, 16(2-4), 351-362.

Context shifts : Extending the meanings of physical objects with language. / McGee, David R.; Pavel, Misha; Cohen, Philip R.

In: Human-Computer Interaction, Vol. 16, No. 2-4, 2001, p. 351-362.

Research output: Contribution to journalArticle

McGee, DR, Pavel, M & Cohen, PR 2001, 'Context shifts: Extending the meanings of physical objects with language', Human-Computer Interaction, vol. 16, no. 2-4, pp. 351-362.
McGee, David R. ; Pavel, Misha ; Cohen, Philip R. / Context shifts : Extending the meanings of physical objects with language. In: Human-Computer Interaction. 2001 ; Vol. 16, No. 2-4. pp. 351-362.
@article{f2958345b5a04c0ca93b6f669c3e96ab,
title = "Context shifts: Extending the meanings of physical objects with language",
abstract = "The influence that language has on contextual interpretations cannot be ignored by computer systems that strive to be context aware. Rather, once systems are designed to perceive language and other forms of human action, these interpretative processes will of necessity be context dependent. As an example, we illustrate how people simply and naturally create new contexts by naming and referring. We then describe Rasa, a mixed-reality system that observes and understands how users in a military command post create such contexts as part of the process of maintaining situational awareness. In such environments, commander's maps are covered with Post-it{\circledR} notes. These paper artifacts are contextually transformed to represent units in the field by the application of multimodal language. Rasa understands this language, thereby allowing paper-based tools to become the basis for digital interaction. Finally, we argue that architectures for such context-aware systems will need to be built to process the inherent ambiguity and uncertainty of human input in order to be effective.",
author = "McGee, {David R.} and Misha Pavel and Cohen, {Philip R.}",
year = "2001",
language = "English (US)",
volume = "16",
pages = "351--362",
journal = "Human-Computer Interaction",
issn = "0737-0024",
publisher = "Taylor and Francis Ltd.",
number = "2-4",

}

TY - JOUR

T1 - Context shifts

T2 - Extending the meanings of physical objects with language

AU - McGee, David R.

AU - Pavel, Misha

AU - Cohen, Philip R.

PY - 2001

Y1 - 2001

N2 - The influence that language has on contextual interpretations cannot be ignored by computer systems that strive to be context aware. Rather, once systems are designed to perceive language and other forms of human action, these interpretative processes will of necessity be context dependent. As an example, we illustrate how people simply and naturally create new contexts by naming and referring. We then describe Rasa, a mixed-reality system that observes and understands how users in a military command post create such contexts as part of the process of maintaining situational awareness. In such environments, commander's maps are covered with Post-it® notes. These paper artifacts are contextually transformed to represent units in the field by the application of multimodal language. Rasa understands this language, thereby allowing paper-based tools to become the basis for digital interaction. Finally, we argue that architectures for such context-aware systems will need to be built to process the inherent ambiguity and uncertainty of human input in order to be effective.

AB - The influence that language has on contextual interpretations cannot be ignored by computer systems that strive to be context aware. Rather, once systems are designed to perceive language and other forms of human action, these interpretative processes will of necessity be context dependent. As an example, we illustrate how people simply and naturally create new contexts by naming and referring. We then describe Rasa, a mixed-reality system that observes and understands how users in a military command post create such contexts as part of the process of maintaining situational awareness. In such environments, commander's maps are covered with Post-it® notes. These paper artifacts are contextually transformed to represent units in the field by the application of multimodal language. Rasa understands this language, thereby allowing paper-based tools to become the basis for digital interaction. Finally, we argue that architectures for such context-aware systems will need to be built to process the inherent ambiguity and uncertainty of human input in order to be effective.

UR - http://www.scopus.com/inward/record.url?scp=0035570936&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=0035570936&partnerID=8YFLogxK

M3 - Article

VL - 16

SP - 351

EP - 362

JO - Human-Computer Interaction

JF - Human-Computer Interaction

SN - 0737-0024

IS - 2-4

ER -