Consistency of observations from echograms made centrally in the Collaborative Ocular Melanoma Study. COMS report no. 13

Sandra Frazier Byrne, Marta J. Marsh, H. Culver Boldt, Ronald L. Green, Robert N. Johnson, David Wilson

Research output: Contribution to journalArticle

16 Citations (Scopus)

Abstract

PURPOSE. To describe the methods used by the Collaborative Ocular Melanoma Study (CAMS) Echography Center for grading tumor echograms and to assess reliability of the grading system. METHODS. Tumor echograms were graded at the COMS Echography Center using a specific protocol. To assess consistency, a five-percent random sample of all echographic gradings received as of June 30, 1996 was selected by the COMS Coordinating Center for re-evaluation at the COMS Echography Center. The results were compared with original data. Agreement between the two sets of gradings was evaluated by calculating overall percent agreement, and by using the kappa statistic for categorical features and intra-class correlation coefficients (ICC) for continuous measures. RESULTS. Overall agreement between original gradings and regradings was high. Agreement, based on the kappa statistic, between the original grading and the regrading was classified as 'moderate,' 'substantial,' or 'almost perfect' for nearly every variable graded. Kappas ranged from 0.47 for extrascleral extension to 0.82 for tumor shape. Intra-class correlation coefficients were 0.99 or higher for tumor height measurements and for the clock hour designation of the tumor apex. The only variable graded by the COMS Echography Center that did not have good agreement was 'confidence in tumor measurement.' CONCLUSIONS. The level of agreement (after adjusting for chance agreement) ranged from 'moderate' to 'almost perfect.' Grading for 'confidence of tumor measurement' differed between the original grading and the regrading but there was little difference in the tumor measurements. The COMS Echography Center has demonstrated that its grading protocol is consistent over time.

Original languageEnglish (US)
Pages (from-to)11-27
Number of pages17
JournalOphthalmic Epidemiology
Volume9
Issue number1
DOIs
StatePublished - Feb 5 2002
Externally publishedYes

Fingerprint

Melanoma
Ultrasonography
Neoplasms
Neoplasm Grading

Keywords

  • Choroidal melanoma
  • Echography
  • Method reliability
  • Radiotherapy
  • Ultrasound

ASJC Scopus subject areas

  • Epidemiology
  • Ophthalmology

Cite this

Consistency of observations from echograms made centrally in the Collaborative Ocular Melanoma Study. COMS report no. 13. / Byrne, Sandra Frazier; Marsh, Marta J.; Boldt, H. Culver; Green, Ronald L.; Johnson, Robert N.; Wilson, David.

In: Ophthalmic Epidemiology, Vol. 9, No. 1, 05.02.2002, p. 11-27.

Research output: Contribution to journalArticle

Byrne, Sandra Frazier ; Marsh, Marta J. ; Boldt, H. Culver ; Green, Ronald L. ; Johnson, Robert N. ; Wilson, David. / Consistency of observations from echograms made centrally in the Collaborative Ocular Melanoma Study. COMS report no. 13. In: Ophthalmic Epidemiology. 2002 ; Vol. 9, No. 1. pp. 11-27.
@article{856b893e8fb1413eb1d02f9fed59d08a,
title = "Consistency of observations from echograms made centrally in the Collaborative Ocular Melanoma Study. COMS report no. 13",
abstract = "PURPOSE. To describe the methods used by the Collaborative Ocular Melanoma Study (CAMS) Echography Center for grading tumor echograms and to assess reliability of the grading system. METHODS. Tumor echograms were graded at the COMS Echography Center using a specific protocol. To assess consistency, a five-percent random sample of all echographic gradings received as of June 30, 1996 was selected by the COMS Coordinating Center for re-evaluation at the COMS Echography Center. The results were compared with original data. Agreement between the two sets of gradings was evaluated by calculating overall percent agreement, and by using the kappa statistic for categorical features and intra-class correlation coefficients (ICC) for continuous measures. RESULTS. Overall agreement between original gradings and regradings was high. Agreement, based on the kappa statistic, between the original grading and the regrading was classified as 'moderate,' 'substantial,' or 'almost perfect' for nearly every variable graded. Kappas ranged from 0.47 for extrascleral extension to 0.82 for tumor shape. Intra-class correlation coefficients were 0.99 or higher for tumor height measurements and for the clock hour designation of the tumor apex. The only variable graded by the COMS Echography Center that did not have good agreement was 'confidence in tumor measurement.' CONCLUSIONS. The level of agreement (after adjusting for chance agreement) ranged from 'moderate' to 'almost perfect.' Grading for 'confidence of tumor measurement' differed between the original grading and the regrading but there was little difference in the tumor measurements. The COMS Echography Center has demonstrated that its grading protocol is consistent over time.",
keywords = "Choroidal melanoma, Echography, Method reliability, Radiotherapy, Ultrasound",
author = "Byrne, {Sandra Frazier} and Marsh, {Marta J.} and Boldt, {H. Culver} and Green, {Ronald L.} and Johnson, {Robert N.} and David Wilson",
year = "2002",
month = "2",
day = "5",
doi = "10.1076/opep.9.1.11.1719",
language = "English (US)",
volume = "9",
pages = "11--27",
journal = "Ophthalmic Epidemiology",
issn = "0928-6586",
publisher = "Informa Healthcare",
number = "1",

}

TY - JOUR

T1 - Consistency of observations from echograms made centrally in the Collaborative Ocular Melanoma Study. COMS report no. 13

AU - Byrne, Sandra Frazier

AU - Marsh, Marta J.

AU - Boldt, H. Culver

AU - Green, Ronald L.

AU - Johnson, Robert N.

AU - Wilson, David

PY - 2002/2/5

Y1 - 2002/2/5

N2 - PURPOSE. To describe the methods used by the Collaborative Ocular Melanoma Study (CAMS) Echography Center for grading tumor echograms and to assess reliability of the grading system. METHODS. Tumor echograms were graded at the COMS Echography Center using a specific protocol. To assess consistency, a five-percent random sample of all echographic gradings received as of June 30, 1996 was selected by the COMS Coordinating Center for re-evaluation at the COMS Echography Center. The results were compared with original data. Agreement between the two sets of gradings was evaluated by calculating overall percent agreement, and by using the kappa statistic for categorical features and intra-class correlation coefficients (ICC) for continuous measures. RESULTS. Overall agreement between original gradings and regradings was high. Agreement, based on the kappa statistic, between the original grading and the regrading was classified as 'moderate,' 'substantial,' or 'almost perfect' for nearly every variable graded. Kappas ranged from 0.47 for extrascleral extension to 0.82 for tumor shape. Intra-class correlation coefficients were 0.99 or higher for tumor height measurements and for the clock hour designation of the tumor apex. The only variable graded by the COMS Echography Center that did not have good agreement was 'confidence in tumor measurement.' CONCLUSIONS. The level of agreement (after adjusting for chance agreement) ranged from 'moderate' to 'almost perfect.' Grading for 'confidence of tumor measurement' differed between the original grading and the regrading but there was little difference in the tumor measurements. The COMS Echography Center has demonstrated that its grading protocol is consistent over time.

AB - PURPOSE. To describe the methods used by the Collaborative Ocular Melanoma Study (CAMS) Echography Center for grading tumor echograms and to assess reliability of the grading system. METHODS. Tumor echograms were graded at the COMS Echography Center using a specific protocol. To assess consistency, a five-percent random sample of all echographic gradings received as of June 30, 1996 was selected by the COMS Coordinating Center for re-evaluation at the COMS Echography Center. The results were compared with original data. Agreement between the two sets of gradings was evaluated by calculating overall percent agreement, and by using the kappa statistic for categorical features and intra-class correlation coefficients (ICC) for continuous measures. RESULTS. Overall agreement between original gradings and regradings was high. Agreement, based on the kappa statistic, between the original grading and the regrading was classified as 'moderate,' 'substantial,' or 'almost perfect' for nearly every variable graded. Kappas ranged from 0.47 for extrascleral extension to 0.82 for tumor shape. Intra-class correlation coefficients were 0.99 or higher for tumor height measurements and for the clock hour designation of the tumor apex. The only variable graded by the COMS Echography Center that did not have good agreement was 'confidence in tumor measurement.' CONCLUSIONS. The level of agreement (after adjusting for chance agreement) ranged from 'moderate' to 'almost perfect.' Grading for 'confidence of tumor measurement' differed between the original grading and the regrading but there was little difference in the tumor measurements. The COMS Echography Center has demonstrated that its grading protocol is consistent over time.

KW - Choroidal melanoma

KW - Echography

KW - Method reliability

KW - Radiotherapy

KW - Ultrasound

UR - http://www.scopus.com/inward/record.url?scp=0036151803&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=0036151803&partnerID=8YFLogxK

U2 - 10.1076/opep.9.1.11.1719

DO - 10.1076/opep.9.1.11.1719

M3 - Article

VL - 9

SP - 11

EP - 27

JO - Ophthalmic Epidemiology

JF - Ophthalmic Epidemiology

SN - 0928-6586

IS - 1

ER -