Objective system for interviewer performance evaluation for use in epidemiologic studies

Sandra Edwards, Martha L. Slattery, Motomi (Tomi) Mori, T. Dennis Berry, Bette J. Caan, Pat Palmer, John D. Potter

Research output: Contribution to journalArticle

143 Citations (Scopus)

Abstract

In this paper, the authors present an objective system to evaluate interviewer performance for use in epidemiologic studies. With this quality control system, all study interviews are audio-taped, and a random sample of interviews are coded according to interviewer behaviors, such as whether the interviewer asked the questions exactly as written and used the probes appropriately. With the use of data obtained from a large case-control study of colon cancer, the authors observed that 94.2% of all questions were asked in the same manner by all interviewers and that 89.5% of all probing behaviors were appropriate. They show that questions that required additional interviewer behaviors were more likely to result in variation in response that can be attributed to the interviewer. These findings have implications for study design and interpretation of study results. From simulations, the authors have estimated the impact of uncorrected interviewer variability on study power and ability to detect disease associations. Uncorrected interviewer variability could decrease study power from 84% to 56%. From simulations, the authors observed that odds ratios could be biased downward from 1.8 to 1.3. These findings illustrate the importance of using a continuous quality control program in epidemiologic research.

Original languageEnglish (US)
Pages (from-to)1020-1028
Number of pages9
JournalAmerican Journal of Epidemiology
Volume140
Issue number11
StatePublished - Dec 1 1994
Externally publishedYes

Fingerprint

Epidemiologic Studies
Interviews
Quality Control
Colonic Neoplasms
Case-Control Studies
Odds Ratio
Research

Keywords

  • Epidemiologic methods
  • Quality control
  • Research design

ASJC Scopus subject areas

  • Geriatrics and Gerontology
  • Epidemiology

Cite this

Edwards, S., Slattery, M. L., Mori, M. T., Berry, T. D., Caan, B. J., Palmer, P., & Potter, J. D. (1994). Objective system for interviewer performance evaluation for use in epidemiologic studies. American Journal of Epidemiology, 140(11), 1020-1028.

Objective system for interviewer performance evaluation for use in epidemiologic studies. / Edwards, Sandra; Slattery, Martha L.; Mori, Motomi (Tomi); Berry, T. Dennis; Caan, Bette J.; Palmer, Pat; Potter, John D.

In: American Journal of Epidemiology, Vol. 140, No. 11, 01.12.1994, p. 1020-1028.

Research output: Contribution to journalArticle

Edwards, S, Slattery, ML, Mori, MT, Berry, TD, Caan, BJ, Palmer, P & Potter, JD 1994, 'Objective system for interviewer performance evaluation for use in epidemiologic studies', American Journal of Epidemiology, vol. 140, no. 11, pp. 1020-1028.
Edwards S, Slattery ML, Mori MT, Berry TD, Caan BJ, Palmer P et al. Objective system for interviewer performance evaluation for use in epidemiologic studies. American Journal of Epidemiology. 1994 Dec 1;140(11):1020-1028.
Edwards, Sandra ; Slattery, Martha L. ; Mori, Motomi (Tomi) ; Berry, T. Dennis ; Caan, Bette J. ; Palmer, Pat ; Potter, John D. / Objective system for interviewer performance evaluation for use in epidemiologic studies. In: American Journal of Epidemiology. 1994 ; Vol. 140, No. 11. pp. 1020-1028.
@article{b28a44ad3f5f4c3383bf50a46593df6b,
title = "Objective system for interviewer performance evaluation for use in epidemiologic studies",
abstract = "In this paper, the authors present an objective system to evaluate interviewer performance for use in epidemiologic studies. With this quality control system, all study interviews are audio-taped, and a random sample of interviews are coded according to interviewer behaviors, such as whether the interviewer asked the questions exactly as written and used the probes appropriately. With the use of data obtained from a large case-control study of colon cancer, the authors observed that 94.2{\%} of all questions were asked in the same manner by all interviewers and that 89.5{\%} of all probing behaviors were appropriate. They show that questions that required additional interviewer behaviors were more likely to result in variation in response that can be attributed to the interviewer. These findings have implications for study design and interpretation of study results. From simulations, the authors have estimated the impact of uncorrected interviewer variability on study power and ability to detect disease associations. Uncorrected interviewer variability could decrease study power from 84{\%} to 56{\%}. From simulations, the authors observed that odds ratios could be biased downward from 1.8 to 1.3. These findings illustrate the importance of using a continuous quality control program in epidemiologic research.",
keywords = "Epidemiologic methods, Quality control, Research design",
author = "Sandra Edwards and Slattery, {Martha L.} and Mori, {Motomi (Tomi)} and Berry, {T. Dennis} and Caan, {Bette J.} and Pat Palmer and Potter, {John D.}",
year = "1994",
month = "12",
day = "1",
language = "English (US)",
volume = "140",
pages = "1020--1028",
journal = "American Journal of Epidemiology",
issn = "0002-9262",
publisher = "Oxford University Press",
number = "11",

}

TY - JOUR

T1 - Objective system for interviewer performance evaluation for use in epidemiologic studies

AU - Edwards, Sandra

AU - Slattery, Martha L.

AU - Mori, Motomi (Tomi)

AU - Berry, T. Dennis

AU - Caan, Bette J.

AU - Palmer, Pat

AU - Potter, John D.

PY - 1994/12/1

Y1 - 1994/12/1

N2 - In this paper, the authors present an objective system to evaluate interviewer performance for use in epidemiologic studies. With this quality control system, all study interviews are audio-taped, and a random sample of interviews are coded according to interviewer behaviors, such as whether the interviewer asked the questions exactly as written and used the probes appropriately. With the use of data obtained from a large case-control study of colon cancer, the authors observed that 94.2% of all questions were asked in the same manner by all interviewers and that 89.5% of all probing behaviors were appropriate. They show that questions that required additional interviewer behaviors were more likely to result in variation in response that can be attributed to the interviewer. These findings have implications for study design and interpretation of study results. From simulations, the authors have estimated the impact of uncorrected interviewer variability on study power and ability to detect disease associations. Uncorrected interviewer variability could decrease study power from 84% to 56%. From simulations, the authors observed that odds ratios could be biased downward from 1.8 to 1.3. These findings illustrate the importance of using a continuous quality control program in epidemiologic research.

AB - In this paper, the authors present an objective system to evaluate interviewer performance for use in epidemiologic studies. With this quality control system, all study interviews are audio-taped, and a random sample of interviews are coded according to interviewer behaviors, such as whether the interviewer asked the questions exactly as written and used the probes appropriately. With the use of data obtained from a large case-control study of colon cancer, the authors observed that 94.2% of all questions were asked in the same manner by all interviewers and that 89.5% of all probing behaviors were appropriate. They show that questions that required additional interviewer behaviors were more likely to result in variation in response that can be attributed to the interviewer. These findings have implications for study design and interpretation of study results. From simulations, the authors have estimated the impact of uncorrected interviewer variability on study power and ability to detect disease associations. Uncorrected interviewer variability could decrease study power from 84% to 56%. From simulations, the authors observed that odds ratios could be biased downward from 1.8 to 1.3. These findings illustrate the importance of using a continuous quality control program in epidemiologic research.

KW - Epidemiologic methods

KW - Quality control

KW - Research design

UR - http://www.scopus.com/inward/record.url?scp=0028102891&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=0028102891&partnerID=8YFLogxK

M3 - Article

C2 - 7985650

AN - SCOPUS:0028102891

VL - 140

SP - 1020

EP - 1028

JO - American Journal of Epidemiology

JF - American Journal of Epidemiology

SN - 0002-9262

IS - 11

ER -