Effects of questionnaire-based diagnosis and training on inter-rater reliability among practitioners of traditional chinese medicine

Scott Mist, Cheryl Ritenbaugh, Mikel Aickin

Research output: Contribution to journalArticle

42 Citations (Scopus)

Abstract

Objective: To investigate whether a training process that focused on a questionnaire-based diagnosis in Traditional Chinese Medicine (TCM), and developing diagnostic consensus, would improve the agreement of TCM diagnoses among 10 TCM practitioners evaluating patients with temporomandibular joint disorder (TMJD). Design and setting: Evaluation of a diagnostic training program at the Department of Family and Community Medicine, University of Arizona, Tucson Arizona, and the Oregon College of Oriental Medicine, Portland, Oregon. Subjects: Screened participants for a study of TCM for TMJD. Practitioners: Ten (10) licensed acupuncturists with a minimum of 5 years licensure and education in Chinese herbs. Methods: A training session using a questionnaire-based diagnostic form was conducted, followed by waves of diagnostic sessions. Between sessions, practitioners discussed the results of the previous round of participants with a focus on reducing variability in primary diagnosis and severity rating of each diagnosis: 3 waves of 5 patients were assessed by 4 practitioner pairs for a total of 120 diagnoses. At 18 months, practitioners completed a recalibration exercise with a similar format with a total of 32 diagnoses. These diagnoses were then examined with respect to the rate of agreement among the 10 practitioners using inter-rater correlations and kappas. Results: The inter-rater correlation with respect to the TCM diagnoses among the 10 practitioners increased from 0.112 to 0.618 with training. Statistically significant improvements were found between the baseline and 18 month exercises (p

Original languageEnglish (US)
Pages (from-to)703-709
Number of pages7
JournalJournal of Alternative and Complementary Medicine
Volume15
Issue number7
DOIs
StatePublished - Jul 1 2009

Fingerprint

Chinese Traditional Medicine
Temporomandibular Joint Disorders
East Asian Traditional Medicine
Exercise
Community Medicine
Education
Surveys and Questionnaires
Licensure
Consensus

ASJC Scopus subject areas

  • Complementary and alternative medicine

Cite this

Effects of questionnaire-based diagnosis and training on inter-rater reliability among practitioners of traditional chinese medicine. / Mist, Scott; Ritenbaugh, Cheryl; Aickin, Mikel.

In: Journal of Alternative and Complementary Medicine, Vol. 15, No. 7, 01.07.2009, p. 703-709.

Research output: Contribution to journalArticle

@article{5a93c8c8f759492e9bed102cdead44c4,
title = "Effects of questionnaire-based diagnosis and training on inter-rater reliability among practitioners of traditional chinese medicine",
abstract = "Objective: To investigate whether a training process that focused on a questionnaire-based diagnosis in Traditional Chinese Medicine (TCM), and developing diagnostic consensus, would improve the agreement of TCM diagnoses among 10 TCM practitioners evaluating patients with temporomandibular joint disorder (TMJD). Design and setting: Evaluation of a diagnostic training program at the Department of Family and Community Medicine, University of Arizona, Tucson Arizona, and the Oregon College of Oriental Medicine, Portland, Oregon. Subjects: Screened participants for a study of TCM for TMJD. Practitioners: Ten (10) licensed acupuncturists with a minimum of 5 years licensure and education in Chinese herbs. Methods: A training session using a questionnaire-based diagnostic form was conducted, followed by waves of diagnostic sessions. Between sessions, practitioners discussed the results of the previous round of participants with a focus on reducing variability in primary diagnosis and severity rating of each diagnosis: 3 waves of 5 patients were assessed by 4 practitioner pairs for a total of 120 diagnoses. At 18 months, practitioners completed a recalibration exercise with a similar format with a total of 32 diagnoses. These diagnoses were then examined with respect to the rate of agreement among the 10 practitioners using inter-rater correlations and kappas. Results: The inter-rater correlation with respect to the TCM diagnoses among the 10 practitioners increased from 0.112 to 0.618 with training. Statistically significant improvements were found between the baseline and 18 month exercises (p",
author = "Scott Mist and Cheryl Ritenbaugh and Mikel Aickin",
year = "2009",
month = "7",
day = "1",
doi = "10.1089/acm.2008.0488",
language = "English (US)",
volume = "15",
pages = "703--709",
journal = "Journal of Alternative and Complementary Medicine",
issn = "1075-5535",
publisher = "Mary Ann Liebert Inc.",
number = "7",

}

TY - JOUR

T1 - Effects of questionnaire-based diagnosis and training on inter-rater reliability among practitioners of traditional chinese medicine

AU - Mist, Scott

AU - Ritenbaugh, Cheryl

AU - Aickin, Mikel

PY - 2009/7/1

Y1 - 2009/7/1

N2 - Objective: To investigate whether a training process that focused on a questionnaire-based diagnosis in Traditional Chinese Medicine (TCM), and developing diagnostic consensus, would improve the agreement of TCM diagnoses among 10 TCM practitioners evaluating patients with temporomandibular joint disorder (TMJD). Design and setting: Evaluation of a diagnostic training program at the Department of Family and Community Medicine, University of Arizona, Tucson Arizona, and the Oregon College of Oriental Medicine, Portland, Oregon. Subjects: Screened participants for a study of TCM for TMJD. Practitioners: Ten (10) licensed acupuncturists with a minimum of 5 years licensure and education in Chinese herbs. Methods: A training session using a questionnaire-based diagnostic form was conducted, followed by waves of diagnostic sessions. Between sessions, practitioners discussed the results of the previous round of participants with a focus on reducing variability in primary diagnosis and severity rating of each diagnosis: 3 waves of 5 patients were assessed by 4 practitioner pairs for a total of 120 diagnoses. At 18 months, practitioners completed a recalibration exercise with a similar format with a total of 32 diagnoses. These diagnoses were then examined with respect to the rate of agreement among the 10 practitioners using inter-rater correlations and kappas. Results: The inter-rater correlation with respect to the TCM diagnoses among the 10 practitioners increased from 0.112 to 0.618 with training. Statistically significant improvements were found between the baseline and 18 month exercises (p

AB - Objective: To investigate whether a training process that focused on a questionnaire-based diagnosis in Traditional Chinese Medicine (TCM), and developing diagnostic consensus, would improve the agreement of TCM diagnoses among 10 TCM practitioners evaluating patients with temporomandibular joint disorder (TMJD). Design and setting: Evaluation of a diagnostic training program at the Department of Family and Community Medicine, University of Arizona, Tucson Arizona, and the Oregon College of Oriental Medicine, Portland, Oregon. Subjects: Screened participants for a study of TCM for TMJD. Practitioners: Ten (10) licensed acupuncturists with a minimum of 5 years licensure and education in Chinese herbs. Methods: A training session using a questionnaire-based diagnostic form was conducted, followed by waves of diagnostic sessions. Between sessions, practitioners discussed the results of the previous round of participants with a focus on reducing variability in primary diagnosis and severity rating of each diagnosis: 3 waves of 5 patients were assessed by 4 practitioner pairs for a total of 120 diagnoses. At 18 months, practitioners completed a recalibration exercise with a similar format with a total of 32 diagnoses. These diagnoses were then examined with respect to the rate of agreement among the 10 practitioners using inter-rater correlations and kappas. Results: The inter-rater correlation with respect to the TCM diagnoses among the 10 practitioners increased from 0.112 to 0.618 with training. Statistically significant improvements were found between the baseline and 18 month exercises (p

UR - http://www.scopus.com/inward/record.url?scp=67749086802&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=67749086802&partnerID=8YFLogxK

U2 - 10.1089/acm.2008.0488

DO - 10.1089/acm.2008.0488

M3 - Article

C2 - 19538100

AN - SCOPUS:67749086802

VL - 15

SP - 703

EP - 709

JO - Journal of Alternative and Complementary Medicine

JF - Journal of Alternative and Complementary Medicine

SN - 1075-5535

IS - 7

ER -