Interrater agreement in the assessment of motor manifestations of Huntington's disease

Penelope (Penny) Hogarth, Elise Kayson, Karl Kieburtz, Karen Marder, David Oakes, Diana Rosas, Ira Shoulson, Nancy S. Wexler, Anne B. Young, Hongwei Zhao, Charles Adler, Roger Albin, Tetsuo Ashizawa, Thomas Bird, Karen Blindauer, Scott Bundlie, James Caress, John Caviness, Sylvain Chouinard, Cynthia ComellaPeter Como, Jody Corey-Bloom, Timothy Counihan, Wallace Deckel, Richard Dubinsky, James Duffy, Leon Dure, Stewart Factor, Andrew Feigin, Hubert Fernandez, Joseph Friedman, Timothy Greenamyre, Mark Guttman, Robert Hauser, Steven Hersch, Bonnie Hersh, Susan Hickenbottom, Donald Higgins, Douglas Hobson, George Jackson, Joseph Jankovic, Danna Jennings, William Johnson, William Koller, Elan Louis, Anne Louis Lafontaine, Carl Leventhal, William Mallonee, Karen Marder, Kenneth Marek, Wayne Martin, Marc Mentis, Eric Molho, Martha Nance, Christopher O'Brien, Constance Orme, David Palmer, Jane Paulsen, George Paulson, Alan Percy, Susan Perlman, Joel Perlmutter, Gerald Podskalny, Kimberly Quiad, Brad Racette, Juan Rachez-Ramos, Lynn Raymond, David Richman, Ted Roberts, Robert Rodnitzky, Christopher Ross, Guy Rouleau, Allen Rubin, Daniel Sax, Neil Schimke, Kathleen Shannon, Paul Shelton, Aileen Shinaman, Leslie Shinobu, Cliff Shults, Eric Siemers, Oksana Suchowersky, Francis Walker, William Weiner, Vicki Wheelock, Joanne Wojcieszek, Frederick Wooten, Ernesto Bonilla, Jang Ho Cha, Margot de Young, Kenneth Fischbeck, Amerigo Negrette, John B. Penney, Maria Ramos, Robert Snodgrass, Leslie Thompson

Research output: Contribution to journalArticle

48 Citations (Scopus)

Abstract

With prospects improving for experimental therapeutics aimed at postponing the onset of illness in preclinical carriers of the Huntington's disease (HD) gene, we assessed agreement among experienced clinicians with respect to the motor manifestations of HD, a relevant outcome measure for preventive trials in this population. Seventy-five clinicians experienced in the evaluation of patients with early HD and six non-clinicians were shown a videotape compiled from the film archives of the United States-Venezuela Collaborative HD Research Project. Observers were asked to rate a 2-3-minute segment of the motor examination for each of 17 at-risk subjects. The rating scale ranged from 0 (normal) to 4 (unequivocal extrapyramidal movement disorder characteristic of HD). As measured by a weighted κ statistic, there was substantial agreement among the 75 clinicians in the judgment of unequivocal motor abnormalities comparing scale ratings of 4 with ratings that were not 4 (weighted κ = 0.67; standard error (SE) = 0.09). Agreement among the non-clinicians was only fair (weighted κ = 0.28; SE = 0.10). Even under the artificial conditions of a videotape study, experienced clinicians show substantial agreement about the signs that constitute the motor manifestations of illness in subjects at risk for HD. We expect these findings to translate to a similar level of interobserver agreement in the clinical trial setting involving experienced investigators examining live patients.

Original languageEnglish (US)
Pages (from-to)293-297
Number of pages5
JournalMovement Disorders
Volume20
Issue number3
DOIs
StatePublished - Mar 2005

Fingerprint

Huntington Disease
Videotape Recording
Basal Ganglia Diseases
Venezuela
Movement Disorders
Motion Pictures
Research Personnel
Outcome Assessment (Health Care)
Clinical Trials
Research
Population
Genes

Keywords

  • Clinical trials
  • Disease progression
  • Huntington's disease

ASJC Scopus subject areas

  • Clinical Neurology
  • Neuroscience(all)

Cite this

Hogarth, P. P., Kayson, E., Kieburtz, K., Marder, K., Oakes, D., Rosas, D., ... Thompson, L. (2005). Interrater agreement in the assessment of motor manifestations of Huntington's disease. Movement Disorders, 20(3), 293-297. https://doi.org/10.1002/mds.20332

Interrater agreement in the assessment of motor manifestations of Huntington's disease. / Hogarth, Penelope (Penny); Kayson, Elise; Kieburtz, Karl; Marder, Karen; Oakes, David; Rosas, Diana; Shoulson, Ira; Wexler, Nancy S.; Young, Anne B.; Zhao, Hongwei; Adler, Charles; Albin, Roger; Ashizawa, Tetsuo; Bird, Thomas; Blindauer, Karen; Bundlie, Scott; Caress, James; Caviness, John; Chouinard, Sylvain; Comella, Cynthia; Como, Peter; Corey-Bloom, Jody; Counihan, Timothy; Deckel, Wallace; Dubinsky, Richard; Duffy, James; Dure, Leon; Factor, Stewart; Feigin, Andrew; Fernandez, Hubert; Friedman, Joseph; Greenamyre, Timothy; Guttman, Mark; Hauser, Robert; Hersch, Steven; Hersh, Bonnie; Hickenbottom, Susan; Higgins, Donald; Hobson, Douglas; Jackson, George; Jankovic, Joseph; Jennings, Danna; Johnson, William; Koller, William; Louis, Elan; Lafontaine, Anne Louis; Leventhal, Carl; Mallonee, William; Marder, Karen; Marek, Kenneth; Martin, Wayne; Mentis, Marc; Molho, Eric; Nance, Martha; O'Brien, Christopher; Orme, Constance; Palmer, David; Paulsen, Jane; Paulson, George; Percy, Alan; Perlman, Susan; Perlmutter, Joel; Podskalny, Gerald; Quiad, Kimberly; Racette, Brad; Rachez-Ramos, Juan; Raymond, Lynn; Richman, David; Roberts, Ted; Rodnitzky, Robert; Ross, Christopher; Rouleau, Guy; Rubin, Allen; Sax, Daniel; Schimke, Neil; Shannon, Kathleen; Shelton, Paul; Shinaman, Aileen; Shinobu, Leslie; Shults, Cliff; Siemers, Eric; Suchowersky, Oksana; Walker, Francis; Weiner, William; Wheelock, Vicki; Wojcieszek, Joanne; Wooten, Frederick; Bonilla, Ernesto; Cha, Jang Ho; de Young, Margot; Fischbeck, Kenneth; Negrette, Amerigo; Penney, John B.; Ramos, Maria; Snodgrass, Robert; Thompson, Leslie.

In: Movement Disorders, Vol. 20, No. 3, 03.2005, p. 293-297.

Research output: Contribution to journalArticle

Hogarth, PP, Kayson, E, Kieburtz, K, Marder, K, Oakes, D, Rosas, D, Shoulson, I, Wexler, NS, Young, AB, Zhao, H, Adler, C, Albin, R, Ashizawa, T, Bird, T, Blindauer, K, Bundlie, S, Caress, J, Caviness, J, Chouinard, S, Comella, C, Como, P, Corey-Bloom, J, Counihan, T, Deckel, W, Dubinsky, R, Duffy, J, Dure, L, Factor, S, Feigin, A, Fernandez, H, Friedman, J, Greenamyre, T, Guttman, M, Hauser, R, Hersch, S, Hersh, B, Hickenbottom, S, Higgins, D, Hobson, D, Jackson, G, Jankovic, J, Jennings, D, Johnson, W, Koller, W, Louis, E, Lafontaine, AL, Leventhal, C, Mallonee, W, Marder, K, Marek, K, Martin, W, Mentis, M, Molho, E, Nance, M, O'Brien, C, Orme, C, Palmer, D, Paulsen, J, Paulson, G, Percy, A, Perlman, S, Perlmutter, J, Podskalny, G, Quiad, K, Racette, B, Rachez-Ramos, J, Raymond, L, Richman, D, Roberts, T, Rodnitzky, R, Ross, C, Rouleau, G, Rubin, A, Sax, D, Schimke, N, Shannon, K, Shelton, P, Shinaman, A, Shinobu, L, Shults, C, Siemers, E, Suchowersky, O, Walker, F, Weiner, W, Wheelock, V, Wojcieszek, J, Wooten, F, Bonilla, E, Cha, JH, de Young, M, Fischbeck, K, Negrette, A, Penney, JB, Ramos, M, Snodgrass, R & Thompson, L 2005, 'Interrater agreement in the assessment of motor manifestations of Huntington's disease', Movement Disorders, vol. 20, no. 3, pp. 293-297. https://doi.org/10.1002/mds.20332
Hogarth, Penelope (Penny) ; Kayson, Elise ; Kieburtz, Karl ; Marder, Karen ; Oakes, David ; Rosas, Diana ; Shoulson, Ira ; Wexler, Nancy S. ; Young, Anne B. ; Zhao, Hongwei ; Adler, Charles ; Albin, Roger ; Ashizawa, Tetsuo ; Bird, Thomas ; Blindauer, Karen ; Bundlie, Scott ; Caress, James ; Caviness, John ; Chouinard, Sylvain ; Comella, Cynthia ; Como, Peter ; Corey-Bloom, Jody ; Counihan, Timothy ; Deckel, Wallace ; Dubinsky, Richard ; Duffy, James ; Dure, Leon ; Factor, Stewart ; Feigin, Andrew ; Fernandez, Hubert ; Friedman, Joseph ; Greenamyre, Timothy ; Guttman, Mark ; Hauser, Robert ; Hersch, Steven ; Hersh, Bonnie ; Hickenbottom, Susan ; Higgins, Donald ; Hobson, Douglas ; Jackson, George ; Jankovic, Joseph ; Jennings, Danna ; Johnson, William ; Koller, William ; Louis, Elan ; Lafontaine, Anne Louis ; Leventhal, Carl ; Mallonee, William ; Marder, Karen ; Marek, Kenneth ; Martin, Wayne ; Mentis, Marc ; Molho, Eric ; Nance, Martha ; O'Brien, Christopher ; Orme, Constance ; Palmer, David ; Paulsen, Jane ; Paulson, George ; Percy, Alan ; Perlman, Susan ; Perlmutter, Joel ; Podskalny, Gerald ; Quiad, Kimberly ; Racette, Brad ; Rachez-Ramos, Juan ; Raymond, Lynn ; Richman, David ; Roberts, Ted ; Rodnitzky, Robert ; Ross, Christopher ; Rouleau, Guy ; Rubin, Allen ; Sax, Daniel ; Schimke, Neil ; Shannon, Kathleen ; Shelton, Paul ; Shinaman, Aileen ; Shinobu, Leslie ; Shults, Cliff ; Siemers, Eric ; Suchowersky, Oksana ; Walker, Francis ; Weiner, William ; Wheelock, Vicki ; Wojcieszek, Joanne ; Wooten, Frederick ; Bonilla, Ernesto ; Cha, Jang Ho ; de Young, Margot ; Fischbeck, Kenneth ; Negrette, Amerigo ; Penney, John B. ; Ramos, Maria ; Snodgrass, Robert ; Thompson, Leslie. / Interrater agreement in the assessment of motor manifestations of Huntington's disease. In: Movement Disorders. 2005 ; Vol. 20, No. 3. pp. 293-297.
@article{2597a901032c4ca8971c41d4e815cccb,
title = "Interrater agreement in the assessment of motor manifestations of Huntington's disease",
abstract = "With prospects improving for experimental therapeutics aimed at postponing the onset of illness in preclinical carriers of the Huntington's disease (HD) gene, we assessed agreement among experienced clinicians with respect to the motor manifestations of HD, a relevant outcome measure for preventive trials in this population. Seventy-five clinicians experienced in the evaluation of patients with early HD and six non-clinicians were shown a videotape compiled from the film archives of the United States-Venezuela Collaborative HD Research Project. Observers were asked to rate a 2-3-minute segment of the motor examination for each of 17 at-risk subjects. The rating scale ranged from 0 (normal) to 4 (unequivocal extrapyramidal movement disorder characteristic of HD). As measured by a weighted κ statistic, there was substantial agreement among the 75 clinicians in the judgment of unequivocal motor abnormalities comparing scale ratings of 4 with ratings that were not 4 (weighted κ = 0.67; standard error (SE) = 0.09). Agreement among the non-clinicians was only fair (weighted κ = 0.28; SE = 0.10). Even under the artificial conditions of a videotape study, experienced clinicians show substantial agreement about the signs that constitute the motor manifestations of illness in subjects at risk for HD. We expect these findings to translate to a similar level of interobserver agreement in the clinical trial setting involving experienced investigators examining live patients.",
keywords = "Clinical trials, Disease progression, Huntington's disease",
author = "Hogarth, {Penelope (Penny)} and Elise Kayson and Karl Kieburtz and Karen Marder and David Oakes and Diana Rosas and Ira Shoulson and Wexler, {Nancy S.} and Young, {Anne B.} and Hongwei Zhao and Charles Adler and Roger Albin and Tetsuo Ashizawa and Thomas Bird and Karen Blindauer and Scott Bundlie and James Caress and John Caviness and Sylvain Chouinard and Cynthia Comella and Peter Como and Jody Corey-Bloom and Timothy Counihan and Wallace Deckel and Richard Dubinsky and James Duffy and Leon Dure and Stewart Factor and Andrew Feigin and Hubert Fernandez and Joseph Friedman and Timothy Greenamyre and Mark Guttman and Robert Hauser and Steven Hersch and Bonnie Hersh and Susan Hickenbottom and Donald Higgins and Douglas Hobson and George Jackson and Joseph Jankovic and Danna Jennings and William Johnson and William Koller and Elan Louis and Lafontaine, {Anne Louis} and Carl Leventhal and William Mallonee and Karen Marder and Kenneth Marek and Wayne Martin and Marc Mentis and Eric Molho and Martha Nance and Christopher O'Brien and Constance Orme and David Palmer and Jane Paulsen and George Paulson and Alan Percy and Susan Perlman and Joel Perlmutter and Gerald Podskalny and Kimberly Quiad and Brad Racette and Juan Rachez-Ramos and Lynn Raymond and David Richman and Ted Roberts and Robert Rodnitzky and Christopher Ross and Guy Rouleau and Allen Rubin and Daniel Sax and Neil Schimke and Kathleen Shannon and Paul Shelton and Aileen Shinaman and Leslie Shinobu and Cliff Shults and Eric Siemers and Oksana Suchowersky and Francis Walker and William Weiner and Vicki Wheelock and Joanne Wojcieszek and Frederick Wooten and Ernesto Bonilla and Cha, {Jang Ho} and {de Young}, Margot and Kenneth Fischbeck and Amerigo Negrette and Penney, {John B.} and Maria Ramos and Robert Snodgrass and Leslie Thompson",
year = "2005",
month = "3",
doi = "10.1002/mds.20332",
language = "English (US)",
volume = "20",
pages = "293--297",
journal = "Movement Disorders",
issn = "0885-3185",
publisher = "John Wiley and Sons Inc.",
number = "3",

}

TY - JOUR

T1 - Interrater agreement in the assessment of motor manifestations of Huntington's disease

AU - Hogarth, Penelope (Penny)

AU - Kayson, Elise

AU - Kieburtz, Karl

AU - Marder, Karen

AU - Oakes, David

AU - Rosas, Diana

AU - Shoulson, Ira

AU - Wexler, Nancy S.

AU - Young, Anne B.

AU - Zhao, Hongwei

AU - Adler, Charles

AU - Albin, Roger

AU - Ashizawa, Tetsuo

AU - Bird, Thomas

AU - Blindauer, Karen

AU - Bundlie, Scott

AU - Caress, James

AU - Caviness, John

AU - Chouinard, Sylvain

AU - Comella, Cynthia

AU - Como, Peter

AU - Corey-Bloom, Jody

AU - Counihan, Timothy

AU - Deckel, Wallace

AU - Dubinsky, Richard

AU - Duffy, James

AU - Dure, Leon

AU - Factor, Stewart

AU - Feigin, Andrew

AU - Fernandez, Hubert

AU - Friedman, Joseph

AU - Greenamyre, Timothy

AU - Guttman, Mark

AU - Hauser, Robert

AU - Hersch, Steven

AU - Hersh, Bonnie

AU - Hickenbottom, Susan

AU - Higgins, Donald

AU - Hobson, Douglas

AU - Jackson, George

AU - Jankovic, Joseph

AU - Jennings, Danna

AU - Johnson, William

AU - Koller, William

AU - Louis, Elan

AU - Lafontaine, Anne Louis

AU - Leventhal, Carl

AU - Mallonee, William

AU - Marder, Karen

AU - Marek, Kenneth

AU - Martin, Wayne

AU - Mentis, Marc

AU - Molho, Eric

AU - Nance, Martha

AU - O'Brien, Christopher

AU - Orme, Constance

AU - Palmer, David

AU - Paulsen, Jane

AU - Paulson, George

AU - Percy, Alan

AU - Perlman, Susan

AU - Perlmutter, Joel

AU - Podskalny, Gerald

AU - Quiad, Kimberly

AU - Racette, Brad

AU - Rachez-Ramos, Juan

AU - Raymond, Lynn

AU - Richman, David

AU - Roberts, Ted

AU - Rodnitzky, Robert

AU - Ross, Christopher

AU - Rouleau, Guy

AU - Rubin, Allen

AU - Sax, Daniel

AU - Schimke, Neil

AU - Shannon, Kathleen

AU - Shelton, Paul

AU - Shinaman, Aileen

AU - Shinobu, Leslie

AU - Shults, Cliff

AU - Siemers, Eric

AU - Suchowersky, Oksana

AU - Walker, Francis

AU - Weiner, William

AU - Wheelock, Vicki

AU - Wojcieszek, Joanne

AU - Wooten, Frederick

AU - Bonilla, Ernesto

AU - Cha, Jang Ho

AU - de Young, Margot

AU - Fischbeck, Kenneth

AU - Negrette, Amerigo

AU - Penney, John B.

AU - Ramos, Maria

AU - Snodgrass, Robert

AU - Thompson, Leslie

PY - 2005/3

Y1 - 2005/3

N2 - With prospects improving for experimental therapeutics aimed at postponing the onset of illness in preclinical carriers of the Huntington's disease (HD) gene, we assessed agreement among experienced clinicians with respect to the motor manifestations of HD, a relevant outcome measure for preventive trials in this population. Seventy-five clinicians experienced in the evaluation of patients with early HD and six non-clinicians were shown a videotape compiled from the film archives of the United States-Venezuela Collaborative HD Research Project. Observers were asked to rate a 2-3-minute segment of the motor examination for each of 17 at-risk subjects. The rating scale ranged from 0 (normal) to 4 (unequivocal extrapyramidal movement disorder characteristic of HD). As measured by a weighted κ statistic, there was substantial agreement among the 75 clinicians in the judgment of unequivocal motor abnormalities comparing scale ratings of 4 with ratings that were not 4 (weighted κ = 0.67; standard error (SE) = 0.09). Agreement among the non-clinicians was only fair (weighted κ = 0.28; SE = 0.10). Even under the artificial conditions of a videotape study, experienced clinicians show substantial agreement about the signs that constitute the motor manifestations of illness in subjects at risk for HD. We expect these findings to translate to a similar level of interobserver agreement in the clinical trial setting involving experienced investigators examining live patients.

AB - With prospects improving for experimental therapeutics aimed at postponing the onset of illness in preclinical carriers of the Huntington's disease (HD) gene, we assessed agreement among experienced clinicians with respect to the motor manifestations of HD, a relevant outcome measure for preventive trials in this population. Seventy-five clinicians experienced in the evaluation of patients with early HD and six non-clinicians were shown a videotape compiled from the film archives of the United States-Venezuela Collaborative HD Research Project. Observers were asked to rate a 2-3-minute segment of the motor examination for each of 17 at-risk subjects. The rating scale ranged from 0 (normal) to 4 (unequivocal extrapyramidal movement disorder characteristic of HD). As measured by a weighted κ statistic, there was substantial agreement among the 75 clinicians in the judgment of unequivocal motor abnormalities comparing scale ratings of 4 with ratings that were not 4 (weighted κ = 0.67; standard error (SE) = 0.09). Agreement among the non-clinicians was only fair (weighted κ = 0.28; SE = 0.10). Even under the artificial conditions of a videotape study, experienced clinicians show substantial agreement about the signs that constitute the motor manifestations of illness in subjects at risk for HD. We expect these findings to translate to a similar level of interobserver agreement in the clinical trial setting involving experienced investigators examining live patients.

KW - Clinical trials

KW - Disease progression

KW - Huntington's disease

UR - http://www.scopus.com/inward/record.url?scp=20944438389&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=20944438389&partnerID=8YFLogxK

U2 - 10.1002/mds.20332

DO - 10.1002/mds.20332

M3 - Article

C2 - 15584032

AN - SCOPUS:20944438389

VL - 20

SP - 293

EP - 297

JO - Movement Disorders

JF - Movement Disorders

SN - 0885-3185

IS - 3

ER -