Intercoder reliability in annotating complex disfluencies

Peter A. Heeman, Andy McMillin, J. Scott Yaruss

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Abstract

In previous work, we presented an annotation scheme that can describe complex disfluencies. In this paper, we first show the prevalence of complex disfluencies and illustrate the types of distinctions that our scheme allows. Second, we present an annotation tool that allows the scheme to be easily applied. Third, we present the results of a reliability study in annotating complex disfluencies with the annotation tool. We find that subjects, even with a minimal amount of training, achieve high intercoder agreement. This work will help pave the way for speech recognizers to precisely model the structure of disfluencies, both for understanding conversational speech of non-stutterers and for assessing stuttering severity.

Original languageEnglish (US)
Title of host publicationInternational Speech Communication Association - 8th Annual Conference of the International Speech Communication Association, Interspeech 2007
Pages1957-1960
Number of pages4
StatePublished - Dec 1 2007
Event8th Annual Conference of the International Speech Communication Association, Interspeech 2007 - Antwerp, Belgium
Duration: Aug 27 2007Aug 31 2007

Publication series

NameInternational Speech Communication Association - 8th Annual Conference of the International Speech Communication Association, Interspeech 2007
Volume3

Other

Other8th Annual Conference of the International Speech Communication Association, Interspeech 2007
CountryBelgium
CityAntwerp
Period8/27/078/31/07

    Fingerprint

Keywords

  • Annotation scheme
  • Disfluencies
  • Stuttering

ASJC Scopus subject areas

  • Computer Science Applications
  • Software
  • Modeling and Simulation
  • Linguistics and Language
  • Communication

Cite this

Heeman, P. A., McMillin, A., & Yaruss, J. S. (2007). Intercoder reliability in annotating complex disfluencies. In International Speech Communication Association - 8th Annual Conference of the International Speech Communication Association, Interspeech 2007 (pp. 1957-1960). (International Speech Communication Association - 8th Annual Conference of the International Speech Communication Association, Interspeech 2007; Vol. 3).