Multisite reliability and repeatability of an advanced brain MRI protocol

on behalf of the NAIMS Cooperative

Research output: Contribution to journalArticle

1 Citation (Scopus)

Abstract

Background: MRI is the imaging modality of choice for diagnosis and intervention assessment in neurological disease. Its full potential has not been realized due in part to challenges in harmonizing advanced techniques across multiple sites. Purpose: To develop a method for the assessment of reliability and repeatability of advanced multisite-multisession neuroimaging studies and specifically to assess the reliability of an advanced MRI protocol, including multiband fMRI and diffusion tensor MRI, in a multisite setting. Study Type: Prospective. Population: Twice repeated measurement of a single subject with stable relapsing-remitting multiple sclerosis (MS) at seven institutions. Field Strength/Sequence: A 3 T MRI protocol included higher spatial resolution anatomical scans, a variable flip-angle longitudinal relaxation rate constant (R1 ≡ 1/T1) measurement, quantitative magnetization transfer imaging, diffusion tensor imaging, and a resting-state fMRI (rsFMRI) series. Assessment: Multiple methods of assessing intrasite repeatability and intersite reliability were evaluated for imaging metrics derived from each sequence. Statistical Tests: Student's t-test, Pearson's r, and intraclass correlation coefficient (ICC) (2,1) were employed to assess repeatability and reliability. Two new statistical metrics are introduced that frame reliability and repeatability in the respective units of the measurements themselves. Results: Intrasite repeatability was excellent for quantitative R1, magnetization transfer ratio (MTR), and diffusion-weighted imaging (DWI) based metrics (r > 0.95). rsFMRI metrics were less repeatable (r = 0.8). Intersite reliability was excellent for R1, MTR, and DWI (ICC >0.9), and moderate for rsFMRI metrics (ICC∼0.4). Data Conclusion: From most reliable to least, using a new reliability metric introduced here, MTR > R1 > DWI > rsFMRI; for repeatability, MTR > DWI > R1 > rsFMRI. A graphical method for at-a-glance assessment of reliability and repeatability, effect sizes, and outlier identification in multisite-multisession neuroimaging studies is introduced. Level of Evidence: 1. Technical Efficacy: Stage 2. J. Magn. Reson. Imaging 2019.

Original languageEnglish (US)
JournalJournal of Magnetic Resonance Imaging
DOIs
StateAccepted/In press - Jan 1 2019

Fingerprint

Magnetic Resonance Imaging
Brain
Neuroimaging
Relapsing-Remitting Multiple Sclerosis
Diffusion Magnetic Resonance Imaging
Diffusion Tensor Imaging
Prospective Studies
Students
Population

Keywords

  • MRI
  • multiple sclerosis
  • multisite
  • reliability
  • repeatability

ASJC Scopus subject areas

  • Radiology Nuclear Medicine and imaging

Cite this

Multisite reliability and repeatability of an advanced brain MRI protocol. / on behalf of the NAIMS Cooperative.

In: Journal of Magnetic Resonance Imaging, 01.01.2019.

Research output: Contribution to journalArticle

@article{abb917e1d4bc46478ca7d295d0dc36ea,
title = "Multisite reliability and repeatability of an advanced brain MRI protocol",
abstract = "Background: MRI is the imaging modality of choice for diagnosis and intervention assessment in neurological disease. Its full potential has not been realized due in part to challenges in harmonizing advanced techniques across multiple sites. Purpose: To develop a method for the assessment of reliability and repeatability of advanced multisite-multisession neuroimaging studies and specifically to assess the reliability of an advanced MRI protocol, including multiband fMRI and diffusion tensor MRI, in a multisite setting. Study Type: Prospective. Population: Twice repeated measurement of a single subject with stable relapsing-remitting multiple sclerosis (MS) at seven institutions. Field Strength/Sequence: A 3 T MRI protocol included higher spatial resolution anatomical scans, a variable flip-angle longitudinal relaxation rate constant (R1 ≡ 1/T1) measurement, quantitative magnetization transfer imaging, diffusion tensor imaging, and a resting-state fMRI (rsFMRI) series. Assessment: Multiple methods of assessing intrasite repeatability and intersite reliability were evaluated for imaging metrics derived from each sequence. Statistical Tests: Student's t-test, Pearson's r, and intraclass correlation coefficient (ICC) (2,1) were employed to assess repeatability and reliability. Two new statistical metrics are introduced that frame reliability and repeatability in the respective units of the measurements themselves. Results: Intrasite repeatability was excellent for quantitative R1, magnetization transfer ratio (MTR), and diffusion-weighted imaging (DWI) based metrics (r > 0.95). rsFMRI metrics were less repeatable (r = 0.8). Intersite reliability was excellent for R1, MTR, and DWI (ICC >0.9), and moderate for rsFMRI metrics (ICC∼0.4). Data Conclusion: From most reliable to least, using a new reliability metric introduced here, MTR > R1 > DWI > rsFMRI; for repeatability, MTR > DWI > R1 > rsFMRI. A graphical method for at-a-glance assessment of reliability and repeatability, effect sizes, and outlier identification in multisite-multisession neuroimaging studies is introduced. Level of Evidence: 1. Technical Efficacy: Stage 2. J. Magn. Reson. Imaging 2019.",
keywords = "MRI, multiple sclerosis, multisite, reliability, repeatability",
author = "{on behalf of the NAIMS Cooperative} and Schwartz, {Daniel L.} and Ian Tagge and Katherine Powers and Sinyeob Ahn and Rohit Bakshi and Calabresi, {Peter A.} and {Todd Constable}, R. and John Grinstead and Henry, {Roland G.} and Govind Nair and Nico Papinutto and Daniel Pelletier and Russell Shinohara and Jiwon Oh and Reich, {Daniel S.} and Sicotte, {Nancy L.} and William Rooney",
year = "2019",
month = "1",
day = "1",
doi = "10.1002/jmri.26652",
language = "English (US)",
journal = "Journal of Magnetic Resonance Imaging",
issn = "1053-1807",
publisher = "John Wiley and Sons Inc.",

}

TY - JOUR

T1 - Multisite reliability and repeatability of an advanced brain MRI protocol

AU - on behalf of the NAIMS Cooperative

AU - Schwartz, Daniel L.

AU - Tagge, Ian

AU - Powers, Katherine

AU - Ahn, Sinyeob

AU - Bakshi, Rohit

AU - Calabresi, Peter A.

AU - Todd Constable, R.

AU - Grinstead, John

AU - Henry, Roland G.

AU - Nair, Govind

AU - Papinutto, Nico

AU - Pelletier, Daniel

AU - Shinohara, Russell

AU - Oh, Jiwon

AU - Reich, Daniel S.

AU - Sicotte, Nancy L.

AU - Rooney, William

PY - 2019/1/1

Y1 - 2019/1/1

N2 - Background: MRI is the imaging modality of choice for diagnosis and intervention assessment in neurological disease. Its full potential has not been realized due in part to challenges in harmonizing advanced techniques across multiple sites. Purpose: To develop a method for the assessment of reliability and repeatability of advanced multisite-multisession neuroimaging studies and specifically to assess the reliability of an advanced MRI protocol, including multiband fMRI and diffusion tensor MRI, in a multisite setting. Study Type: Prospective. Population: Twice repeated measurement of a single subject with stable relapsing-remitting multiple sclerosis (MS) at seven institutions. Field Strength/Sequence: A 3 T MRI protocol included higher spatial resolution anatomical scans, a variable flip-angle longitudinal relaxation rate constant (R1 ≡ 1/T1) measurement, quantitative magnetization transfer imaging, diffusion tensor imaging, and a resting-state fMRI (rsFMRI) series. Assessment: Multiple methods of assessing intrasite repeatability and intersite reliability were evaluated for imaging metrics derived from each sequence. Statistical Tests: Student's t-test, Pearson's r, and intraclass correlation coefficient (ICC) (2,1) were employed to assess repeatability and reliability. Two new statistical metrics are introduced that frame reliability and repeatability in the respective units of the measurements themselves. Results: Intrasite repeatability was excellent for quantitative R1, magnetization transfer ratio (MTR), and diffusion-weighted imaging (DWI) based metrics (r > 0.95). rsFMRI metrics were less repeatable (r = 0.8). Intersite reliability was excellent for R1, MTR, and DWI (ICC >0.9), and moderate for rsFMRI metrics (ICC∼0.4). Data Conclusion: From most reliable to least, using a new reliability metric introduced here, MTR > R1 > DWI > rsFMRI; for repeatability, MTR > DWI > R1 > rsFMRI. A graphical method for at-a-glance assessment of reliability and repeatability, effect sizes, and outlier identification in multisite-multisession neuroimaging studies is introduced. Level of Evidence: 1. Technical Efficacy: Stage 2. J. Magn. Reson. Imaging 2019.

AB - Background: MRI is the imaging modality of choice for diagnosis and intervention assessment in neurological disease. Its full potential has not been realized due in part to challenges in harmonizing advanced techniques across multiple sites. Purpose: To develop a method for the assessment of reliability and repeatability of advanced multisite-multisession neuroimaging studies and specifically to assess the reliability of an advanced MRI protocol, including multiband fMRI and diffusion tensor MRI, in a multisite setting. Study Type: Prospective. Population: Twice repeated measurement of a single subject with stable relapsing-remitting multiple sclerosis (MS) at seven institutions. Field Strength/Sequence: A 3 T MRI protocol included higher spatial resolution anatomical scans, a variable flip-angle longitudinal relaxation rate constant (R1 ≡ 1/T1) measurement, quantitative magnetization transfer imaging, diffusion tensor imaging, and a resting-state fMRI (rsFMRI) series. Assessment: Multiple methods of assessing intrasite repeatability and intersite reliability were evaluated for imaging metrics derived from each sequence. Statistical Tests: Student's t-test, Pearson's r, and intraclass correlation coefficient (ICC) (2,1) were employed to assess repeatability and reliability. Two new statistical metrics are introduced that frame reliability and repeatability in the respective units of the measurements themselves. Results: Intrasite repeatability was excellent for quantitative R1, magnetization transfer ratio (MTR), and diffusion-weighted imaging (DWI) based metrics (r > 0.95). rsFMRI metrics were less repeatable (r = 0.8). Intersite reliability was excellent for R1, MTR, and DWI (ICC >0.9), and moderate for rsFMRI metrics (ICC∼0.4). Data Conclusion: From most reliable to least, using a new reliability metric introduced here, MTR > R1 > DWI > rsFMRI; for repeatability, MTR > DWI > R1 > rsFMRI. A graphical method for at-a-glance assessment of reliability and repeatability, effect sizes, and outlier identification in multisite-multisession neuroimaging studies is introduced. Level of Evidence: 1. Technical Efficacy: Stage 2. J. Magn. Reson. Imaging 2019.

KW - MRI

KW - multiple sclerosis

KW - multisite

KW - reliability

KW - repeatability

UR - http://www.scopus.com/inward/record.url?scp=85060152881&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=85060152881&partnerID=8YFLogxK

U2 - 10.1002/jmri.26652

DO - 10.1002/jmri.26652

M3 - Article

AN - SCOPUS:85060152881

JO - Journal of Magnetic Resonance Imaging

JF - Journal of Magnetic Resonance Imaging

SN - 1053-1807

ER -