Relationship of subjective ratings of image quality and observer performance

Howard E. Rockette, Christopher M. Johns, Jane L. Weissman, J. Michael Holbert, Jules H. Sumkin, Jill L. King, David Gur

Research output: Contribution to journalConference article

5 Scopus citations

Abstract

The relationship between radiologists' perception of image quality and their actual performance was assessed. If the two variables are strongly correlated, the easier obtained perception of quality index might be used as a prerequisite test to determine if a ROC study is justified. One-hundred seventy cases were evaluated for the presence or absence of interstitial disease and nodules by nine readers using seven display modes. Each reader also assigned each image a mode- specific perceived quality rating using a 5-category ordinal scale. Average perceived quality was highest for conventional film. It was slightly poorer for the subsets of cases with interstitial disease and for cases classified independently as 'subtle.' Trend tests indicated a relationship between area under the ROC curves (Az) and perceived image quality for nodules. For interstitial disease, the relationship was weaker and of borderline statistical significance. The subjective image quality index was related to the area under the ROC curve, but the average difference between pairs of display modes was not a good predictor of difference in actual observer performances. A subjective quality index may have limited usefulness in screening differences between modalities prior to the performance of a ROC study.

Original languageEnglish (US)
Pages (from-to)152-159
Number of pages8
JournalProceedings of SPIE - The International Society for Optical Engineering
Volume3036
DOIs
StatePublished - Dec 1 1997
EventMedical Imaging 1997: Image Perception - Newport Beach, CA, United States
Duration: Feb 26 1997Feb 26 1997

    Fingerprint

Keywords

  • Diagnosis
  • Image quality
  • Observer performance
  • Receiver Operating Characteristic (ROC)

ASJC Scopus subject areas

  • Electronic, Optical and Magnetic Materials
  • Condensed Matter Physics
  • Computer Science Applications
  • Applied Mathematics
  • Electrical and Electronic Engineering

Cite this

Rockette, H. E., Johns, C. M., Weissman, J. L., Holbert, J. M., Sumkin, J. H., King, J. L., & Gur, D. (1997). Relationship of subjective ratings of image quality and observer performance. Proceedings of SPIE - The International Society for Optical Engineering, 3036, 152-159. https://doi.org/10.1117/12.271287