Speaker recognition using prosodic and lexical features

Sachin Kajarekar, Luciana Ferrer, Anand Venkataraman, Mustafa (Kemal) Sonmez, Elizabeth Shriberg, Andreas Stolcke, Harry Bratt, Ramana Rao Gadde

Research output: Chapter in Book/Report/Conference proceedingConference contribution

12 Citations (Scopus)

Abstract

Conventional speaker recognition systems identify speakers by using spectral information from very short slices of speech. Such systems perform well (especially in quiet conditions), but fail to capture idiosyncratic longer-term patterns in a speaker's habitual speaking style, including duration and pausing patterns, intonation contours, and the use of particular phrases. We investigate the contribution of modeling such prosodic and lexical patterns, on performance in the NIST 2003 Speaker Recognition Evaluation extended data task. We report results for (1) systems based on individual feature types alone, (2) systems in combination with a state-of-the-art frame-based baseline system, and (3) an all-system combination. Our results show that certain longer-term stylistic features provide powerful complementary information to both frame-level cepstral features and to each other. Stylistic features thus significantly improve speaker recognition performance over conventional systems, and offer promise for a variety of intelligence and security applications.

Original languageEnglish (US)
Title of host publication2003 IEEE Workshop on Automatic Speech Recognition and Understanding, ASRU 2003
PublisherInstitute of Electrical and Electronics Engineers Inc.
Pages19-24
Number of pages6
ISBN (Print)0780379802, 9780780379800
DOIs
StatePublished - 2003
Externally publishedYes
EventIEEE Workshop on Automatic Speech Recognition and Understanding, ASRU 2003 - St. Thomas, United States
Duration: Nov 30 2003Dec 4 2003

Other

OtherIEEE Workshop on Automatic Speech Recognition and Understanding, ASRU 2003
CountryUnited States
CitySt. Thomas
Period11/30/0312/4/03

ASJC Scopus subject areas

  • Signal Processing
  • Computer Vision and Pattern Recognition
  • Computer Science Applications

Cite this

Kajarekar, S., Ferrer, L., Venkataraman, A., Sonmez, M. K., Shriberg, E., Stolcke, A., ... Gadde, R. R. (2003). Speaker recognition using prosodic and lexical features. In 2003 IEEE Workshop on Automatic Speech Recognition and Understanding, ASRU 2003 (pp. 19-24). [1318397] Institute of Electrical and Electronics Engineers Inc.. https://doi.org/10.1109/ASRU.2003.1318397

Speaker recognition using prosodic and lexical features. / Kajarekar, Sachin; Ferrer, Luciana; Venkataraman, Anand; Sonmez, Mustafa (Kemal); Shriberg, Elizabeth; Stolcke, Andreas; Bratt, Harry; Gadde, Ramana Rao.

2003 IEEE Workshop on Automatic Speech Recognition and Understanding, ASRU 2003. Institute of Electrical and Electronics Engineers Inc., 2003. p. 19-24 1318397.

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Kajarekar, S, Ferrer, L, Venkataraman, A, Sonmez, MK, Shriberg, E, Stolcke, A, Bratt, H & Gadde, RR 2003, Speaker recognition using prosodic and lexical features. in 2003 IEEE Workshop on Automatic Speech Recognition and Understanding, ASRU 2003., 1318397, Institute of Electrical and Electronics Engineers Inc., pp. 19-24, IEEE Workshop on Automatic Speech Recognition and Understanding, ASRU 2003, St. Thomas, United States, 11/30/03. https://doi.org/10.1109/ASRU.2003.1318397
Kajarekar S, Ferrer L, Venkataraman A, Sonmez MK, Shriberg E, Stolcke A et al. Speaker recognition using prosodic and lexical features. In 2003 IEEE Workshop on Automatic Speech Recognition and Understanding, ASRU 2003. Institute of Electrical and Electronics Engineers Inc. 2003. p. 19-24. 1318397 https://doi.org/10.1109/ASRU.2003.1318397
Kajarekar, Sachin ; Ferrer, Luciana ; Venkataraman, Anand ; Sonmez, Mustafa (Kemal) ; Shriberg, Elizabeth ; Stolcke, Andreas ; Bratt, Harry ; Gadde, Ramana Rao. / Speaker recognition using prosodic and lexical features. 2003 IEEE Workshop on Automatic Speech Recognition and Understanding, ASRU 2003. Institute of Electrical and Electronics Engineers Inc., 2003. pp. 19-24
@inproceedings{450a09c2ba244930af62b6d7fd0c4ff2,
title = "Speaker recognition using prosodic and lexical features",
abstract = "Conventional speaker recognition systems identify speakers by using spectral information from very short slices of speech. Such systems perform well (especially in quiet conditions), but fail to capture idiosyncratic longer-term patterns in a speaker's habitual speaking style, including duration and pausing patterns, intonation contours, and the use of particular phrases. We investigate the contribution of modeling such prosodic and lexical patterns, on performance in the NIST 2003 Speaker Recognition Evaluation extended data task. We report results for (1) systems based on individual feature types alone, (2) systems in combination with a state-of-the-art frame-based baseline system, and (3) an all-system combination. Our results show that certain longer-term stylistic features provide powerful complementary information to both frame-level cepstral features and to each other. Stylistic features thus significantly improve speaker recognition performance over conventional systems, and offer promise for a variety of intelligence and security applications.",
author = "Sachin Kajarekar and Luciana Ferrer and Anand Venkataraman and Sonmez, {Mustafa (Kemal)} and Elizabeth Shriberg and Andreas Stolcke and Harry Bratt and Gadde, {Ramana Rao}",
year = "2003",
doi = "10.1109/ASRU.2003.1318397",
language = "English (US)",
isbn = "0780379802",
pages = "19--24",
booktitle = "2003 IEEE Workshop on Automatic Speech Recognition and Understanding, ASRU 2003",
publisher = "Institute of Electrical and Electronics Engineers Inc.",

}

TY - GEN

T1 - Speaker recognition using prosodic and lexical features

AU - Kajarekar, Sachin

AU - Ferrer, Luciana

AU - Venkataraman, Anand

AU - Sonmez, Mustafa (Kemal)

AU - Shriberg, Elizabeth

AU - Stolcke, Andreas

AU - Bratt, Harry

AU - Gadde, Ramana Rao

PY - 2003

Y1 - 2003

N2 - Conventional speaker recognition systems identify speakers by using spectral information from very short slices of speech. Such systems perform well (especially in quiet conditions), but fail to capture idiosyncratic longer-term patterns in a speaker's habitual speaking style, including duration and pausing patterns, intonation contours, and the use of particular phrases. We investigate the contribution of modeling such prosodic and lexical patterns, on performance in the NIST 2003 Speaker Recognition Evaluation extended data task. We report results for (1) systems based on individual feature types alone, (2) systems in combination with a state-of-the-art frame-based baseline system, and (3) an all-system combination. Our results show that certain longer-term stylistic features provide powerful complementary information to both frame-level cepstral features and to each other. Stylistic features thus significantly improve speaker recognition performance over conventional systems, and offer promise for a variety of intelligence and security applications.

AB - Conventional speaker recognition systems identify speakers by using spectral information from very short slices of speech. Such systems perform well (especially in quiet conditions), but fail to capture idiosyncratic longer-term patterns in a speaker's habitual speaking style, including duration and pausing patterns, intonation contours, and the use of particular phrases. We investigate the contribution of modeling such prosodic and lexical patterns, on performance in the NIST 2003 Speaker Recognition Evaluation extended data task. We report results for (1) systems based on individual feature types alone, (2) systems in combination with a state-of-the-art frame-based baseline system, and (3) an all-system combination. Our results show that certain longer-term stylistic features provide powerful complementary information to both frame-level cepstral features and to each other. Stylistic features thus significantly improve speaker recognition performance over conventional systems, and offer promise for a variety of intelligence and security applications.

UR - http://www.scopus.com/inward/record.url?scp=78651105404&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=78651105404&partnerID=8YFLogxK

U2 - 10.1109/ASRU.2003.1318397

DO - 10.1109/ASRU.2003.1318397

M3 - Conference contribution

SN - 0780379802

SN - 9780780379800

SP - 19

EP - 24

BT - 2003 IEEE Workshop on Automatic Speech Recognition and Understanding, ASRU 2003

PB - Institute of Electrical and Electronics Engineers Inc.

ER -