Methods and reliability of radiographic vertebral fracture detection in older men

The osteoporotic fractures in men study

Peggy M. Cawthon, Jane Haslam, Robin Fullman, Katherine W. Peters, Dennis Black, Kristine E. Ensrud, Steven R. Cummings, Eric Orwoll, Elizabeth Barrett-Connor, Lynn Marshall, Peter Steiger, John T. Schousboe

Research output: Contribution to journalArticle

20 Citations (Scopus)

Abstract

We describe the methods and reliability of radiographic vertebral fracture assessment in MrOS, a cohort of community dwelling men aged ≥. 65. yrs.Lateral spine radiographs were obtained at Visit 1 (2000-2) and 4.6. years later (Visit 2). Using a workflow tool (SpineAnalyzer™, Optasia Medical), a physician reader completed semi-quantitative (SQ) scoring. Prior to SQ scoring, technicians performed "triage" to reduce physician reader workload, whereby clearly normal spine images were eliminated from SQ scoring with all levels assumed to be SQ. = 0 (no fracture, "triage negative"); spine images with any possible fracture or abnormality were passed to the physician reader as "triage positive" images. Using a quality assurance sample of images (n. = 20 participants; 8 with baseline only and 12 with baseline and follow-up images) read multiple times, we calculated intra-reader kappa statistics and percent agreement for SQ scores. A subset of 494 participants' images was read regardless of triage classification to calculate the specificity and sensitivity of triage.Technically adequate images were available for 5958 of 5994 participants at Visit 1, and 4399 of 4423 participants at Visit 2. Triage identified 3215 (53.9%) participants with radiographs that required further evaluation by the physician reader. For prevalent fractures at Visit 1 (SQ. ≥. 1), intra-reader kappa statistics ranged from 0.79 to 0.92; percent agreement ranged from 96.9% to 98.9%; sensitivity of the triage was 96.8% and specificity of triage was 46.3%.In conclusion, SQ scoring had excellent intra-rater reliability in our study. The triage process reduces expert reader workload without hindering the ability to identify vertebral fractures.

Original languageEnglish (US)
Pages (from-to)152-155
Number of pages4
JournalBone
Volume67
DOIs
StatePublished - 2014

Fingerprint

Osteoporotic Fractures
Triage
Physicians
Spine
Workload
Independent Living
Workflow
Sensitivity and Specificity

Keywords

  • Assessment
  • Men
  • Methodology
  • Semi-quantitative grading
  • Vertebral fractures

ASJC Scopus subject areas

  • Physiology
  • Endocrinology, Diabetes and Metabolism
  • Histology

Cite this

Cawthon, P. M., Haslam, J., Fullman, R., Peters, K. W., Black, D., Ensrud, K. E., ... Schousboe, J. T. (2014). Methods and reliability of radiographic vertebral fracture detection in older men: The osteoporotic fractures in men study. Bone, 67, 152-155. https://doi.org/10.1016/j.bone.2014.06.039

Methods and reliability of radiographic vertebral fracture detection in older men : The osteoporotic fractures in men study. / Cawthon, Peggy M.; Haslam, Jane; Fullman, Robin; Peters, Katherine W.; Black, Dennis; Ensrud, Kristine E.; Cummings, Steven R.; Orwoll, Eric; Barrett-Connor, Elizabeth; Marshall, Lynn; Steiger, Peter; Schousboe, John T.

In: Bone, Vol. 67, 2014, p. 152-155.

Research output: Contribution to journalArticle

Cawthon, PM, Haslam, J, Fullman, R, Peters, KW, Black, D, Ensrud, KE, Cummings, SR, Orwoll, E, Barrett-Connor, E, Marshall, L, Steiger, P & Schousboe, JT 2014, 'Methods and reliability of radiographic vertebral fracture detection in older men: The osteoporotic fractures in men study', Bone, vol. 67, pp. 152-155. https://doi.org/10.1016/j.bone.2014.06.039
Cawthon, Peggy M. ; Haslam, Jane ; Fullman, Robin ; Peters, Katherine W. ; Black, Dennis ; Ensrud, Kristine E. ; Cummings, Steven R. ; Orwoll, Eric ; Barrett-Connor, Elizabeth ; Marshall, Lynn ; Steiger, Peter ; Schousboe, John T. / Methods and reliability of radiographic vertebral fracture detection in older men : The osteoporotic fractures in men study. In: Bone. 2014 ; Vol. 67. pp. 152-155.
@article{409872c19d424fd8bd9f948b630e2445,
title = "Methods and reliability of radiographic vertebral fracture detection in older men: The osteoporotic fractures in men study",
abstract = "We describe the methods and reliability of radiographic vertebral fracture assessment in MrOS, a cohort of community dwelling men aged ≥. 65. yrs.Lateral spine radiographs were obtained at Visit 1 (2000-2) and 4.6. years later (Visit 2). Using a workflow tool (SpineAnalyzer™, Optasia Medical), a physician reader completed semi-quantitative (SQ) scoring. Prior to SQ scoring, technicians performed {"}triage{"} to reduce physician reader workload, whereby clearly normal spine images were eliminated from SQ scoring with all levels assumed to be SQ. = 0 (no fracture, {"}triage negative{"}); spine images with any possible fracture or abnormality were passed to the physician reader as {"}triage positive{"} images. Using a quality assurance sample of images (n. = 20 participants; 8 with baseline only and 12 with baseline and follow-up images) read multiple times, we calculated intra-reader kappa statistics and percent agreement for SQ scores. A subset of 494 participants' images was read regardless of triage classification to calculate the specificity and sensitivity of triage.Technically adequate images were available for 5958 of 5994 participants at Visit 1, and 4399 of 4423 participants at Visit 2. Triage identified 3215 (53.9{\%}) participants with radiographs that required further evaluation by the physician reader. For prevalent fractures at Visit 1 (SQ. ≥. 1), intra-reader kappa statistics ranged from 0.79 to 0.92; percent agreement ranged from 96.9{\%} to 98.9{\%}; sensitivity of the triage was 96.8{\%} and specificity of triage was 46.3{\%}.In conclusion, SQ scoring had excellent intra-rater reliability in our study. The triage process reduces expert reader workload without hindering the ability to identify vertebral fractures.",
keywords = "Assessment, Men, Methodology, Semi-quantitative grading, Vertebral fractures",
author = "Cawthon, {Peggy M.} and Jane Haslam and Robin Fullman and Peters, {Katherine W.} and Dennis Black and Ensrud, {Kristine E.} and Cummings, {Steven R.} and Eric Orwoll and Elizabeth Barrett-Connor and Lynn Marshall and Peter Steiger and Schousboe, {John T.}",
year = "2014",
doi = "10.1016/j.bone.2014.06.039",
language = "English (US)",
volume = "67",
pages = "152--155",
journal = "Bone",
issn = "8756-3282",
publisher = "Elsevier Inc.",

}

TY - JOUR

T1 - Methods and reliability of radiographic vertebral fracture detection in older men

T2 - The osteoporotic fractures in men study

AU - Cawthon, Peggy M.

AU - Haslam, Jane

AU - Fullman, Robin

AU - Peters, Katherine W.

AU - Black, Dennis

AU - Ensrud, Kristine E.

AU - Cummings, Steven R.

AU - Orwoll, Eric

AU - Barrett-Connor, Elizabeth

AU - Marshall, Lynn

AU - Steiger, Peter

AU - Schousboe, John T.

PY - 2014

Y1 - 2014

N2 - We describe the methods and reliability of radiographic vertebral fracture assessment in MrOS, a cohort of community dwelling men aged ≥. 65. yrs.Lateral spine radiographs were obtained at Visit 1 (2000-2) and 4.6. years later (Visit 2). Using a workflow tool (SpineAnalyzer™, Optasia Medical), a physician reader completed semi-quantitative (SQ) scoring. Prior to SQ scoring, technicians performed "triage" to reduce physician reader workload, whereby clearly normal spine images were eliminated from SQ scoring with all levels assumed to be SQ. = 0 (no fracture, "triage negative"); spine images with any possible fracture or abnormality were passed to the physician reader as "triage positive" images. Using a quality assurance sample of images (n. = 20 participants; 8 with baseline only and 12 with baseline and follow-up images) read multiple times, we calculated intra-reader kappa statistics and percent agreement for SQ scores. A subset of 494 participants' images was read regardless of triage classification to calculate the specificity and sensitivity of triage.Technically adequate images were available for 5958 of 5994 participants at Visit 1, and 4399 of 4423 participants at Visit 2. Triage identified 3215 (53.9%) participants with radiographs that required further evaluation by the physician reader. For prevalent fractures at Visit 1 (SQ. ≥. 1), intra-reader kappa statistics ranged from 0.79 to 0.92; percent agreement ranged from 96.9% to 98.9%; sensitivity of the triage was 96.8% and specificity of triage was 46.3%.In conclusion, SQ scoring had excellent intra-rater reliability in our study. The triage process reduces expert reader workload without hindering the ability to identify vertebral fractures.

AB - We describe the methods and reliability of radiographic vertebral fracture assessment in MrOS, a cohort of community dwelling men aged ≥. 65. yrs.Lateral spine radiographs were obtained at Visit 1 (2000-2) and 4.6. years later (Visit 2). Using a workflow tool (SpineAnalyzer™, Optasia Medical), a physician reader completed semi-quantitative (SQ) scoring. Prior to SQ scoring, technicians performed "triage" to reduce physician reader workload, whereby clearly normal spine images were eliminated from SQ scoring with all levels assumed to be SQ. = 0 (no fracture, "triage negative"); spine images with any possible fracture or abnormality were passed to the physician reader as "triage positive" images. Using a quality assurance sample of images (n. = 20 participants; 8 with baseline only and 12 with baseline and follow-up images) read multiple times, we calculated intra-reader kappa statistics and percent agreement for SQ scores. A subset of 494 participants' images was read regardless of triage classification to calculate the specificity and sensitivity of triage.Technically adequate images were available for 5958 of 5994 participants at Visit 1, and 4399 of 4423 participants at Visit 2. Triage identified 3215 (53.9%) participants with radiographs that required further evaluation by the physician reader. For prevalent fractures at Visit 1 (SQ. ≥. 1), intra-reader kappa statistics ranged from 0.79 to 0.92; percent agreement ranged from 96.9% to 98.9%; sensitivity of the triage was 96.8% and specificity of triage was 46.3%.In conclusion, SQ scoring had excellent intra-rater reliability in our study. The triage process reduces expert reader workload without hindering the ability to identify vertebral fractures.

KW - Assessment

KW - Men

KW - Methodology

KW - Semi-quantitative grading

KW - Vertebral fractures

UR - http://www.scopus.com/inward/record.url?scp=84904738991&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=84904738991&partnerID=8YFLogxK

U2 - 10.1016/j.bone.2014.06.039

DO - 10.1016/j.bone.2014.06.039

M3 - Article

VL - 67

SP - 152

EP - 155

JO - Bone

JF - Bone

SN - 8756-3282

ER -