A comparison of the National Ambulatory Medical Care Survey (NAMCS) measurement approach with direct observation of outpatient visits

Valerie J. Gilchrist, Kurt C. Stange, Sue Flocke, Gary McCord, Claire C. Bourguet

Research output: Contribution to journalReview article

144 Citations (Scopus)

Abstract

Background: The National Ambulatory Medical Care Survey (NAMCS) informs a wide range of important policy and clinical decisions by providing nationally representative data about outpatient practice. However, the validity of the NAMCS methods has not been compared with a reference standard. Methods: Office visits of 549 patients visiting 30 family physicians in Northeastern Ohio were observed by trained research nurses. Visit content measured by direct observation was compared with data reported by physicians using the 1993 NAMCS form. Results: Outpatient visit physician reports of procedures and examinations using the NAMCS method showed generally good concordance with direct observation measures, with kappas ranging from 0.39 for ordering a chest x-ray to 0.86 for performance of Pap smears. Concordance was generally lower for health behavior counseling, with kappas ranging from 0.21 for alcohol counseling to 0.60 for smoking cessation advice. The NAMCS form had high specificity (range, 0.90-0.99) but variable (range, 0.12-.84) sensitivity compared with direct observation, with the lowest sensitivities for health behavior counseling. The NAMCS physician report method overestimated visit duration in comparison with direct observation (16.5 vs. 12.8 minutes). Conclusions: Compared with direct observation of outpatient visits, the NAMCS physician report method is more accurate for procedures and examinations than for health behavior counseling. Underreporting of behavioral counseling and overreporting of visit duration should lead to caution in interpreting findings based on these variables.

Original languageEnglish (US)
Pages (from-to)276-280
Number of pages5
JournalMedical care
Volume42
Issue number3
DOIs
StatePublished - Mar 1 2004
Externally publishedYes

Fingerprint

Health Care Surveys
Outpatients
Observation
Counseling
Health Behavior
Physicians
Papanicolaou Test
Office Visits
Family Physicians
Smoking Cessation
Thorax
Nurses
Alcohols
X-Rays
Research

Keywords

  • Ambulatory care
  • Direct observation
  • NAMCS
  • Primary care
  • Validity and reliability

ASJC Scopus subject areas

  • Public Health, Environmental and Occupational Health

Cite this

A comparison of the National Ambulatory Medical Care Survey (NAMCS) measurement approach with direct observation of outpatient visits. / Gilchrist, Valerie J.; Stange, Kurt C.; Flocke, Sue; McCord, Gary; Bourguet, Claire C.

In: Medical care, Vol. 42, No. 3, 01.03.2004, p. 276-280.

Research output: Contribution to journalReview article

Gilchrist, Valerie J. ; Stange, Kurt C. ; Flocke, Sue ; McCord, Gary ; Bourguet, Claire C. / A comparison of the National Ambulatory Medical Care Survey (NAMCS) measurement approach with direct observation of outpatient visits. In: Medical care. 2004 ; Vol. 42, No. 3. pp. 276-280.
@article{c6b586035464463bb935fe85a87b2a1b,
title = "A comparison of the National Ambulatory Medical Care Survey (NAMCS) measurement approach with direct observation of outpatient visits",
abstract = "Background: The National Ambulatory Medical Care Survey (NAMCS) informs a wide range of important policy and clinical decisions by providing nationally representative data about outpatient practice. However, the validity of the NAMCS methods has not been compared with a reference standard. Methods: Office visits of 549 patients visiting 30 family physicians in Northeastern Ohio were observed by trained research nurses. Visit content measured by direct observation was compared with data reported by physicians using the 1993 NAMCS form. Results: Outpatient visit physician reports of procedures and examinations using the NAMCS method showed generally good concordance with direct observation measures, with kappas ranging from 0.39 for ordering a chest x-ray to 0.86 for performance of Pap smears. Concordance was generally lower for health behavior counseling, with kappas ranging from 0.21 for alcohol counseling to 0.60 for smoking cessation advice. The NAMCS form had high specificity (range, 0.90-0.99) but variable (range, 0.12-.84) sensitivity compared with direct observation, with the lowest sensitivities for health behavior counseling. The NAMCS physician report method overestimated visit duration in comparison with direct observation (16.5 vs. 12.8 minutes). Conclusions: Compared with direct observation of outpatient visits, the NAMCS physician report method is more accurate for procedures and examinations than for health behavior counseling. Underreporting of behavioral counseling and overreporting of visit duration should lead to caution in interpreting findings based on these variables.",
keywords = "Ambulatory care, Direct observation, NAMCS, Primary care, Validity and reliability",
author = "Gilchrist, {Valerie J.} and Stange, {Kurt C.} and Sue Flocke and Gary McCord and Bourguet, {Claire C.}",
year = "2004",
month = "3",
day = "1",
doi = "10.1097/01.mlr.0000114916.95639.af",
language = "English (US)",
volume = "42",
pages = "276--280",
journal = "Medical Care",
issn = "0025-7079",
publisher = "Lippincott Williams and Wilkins",
number = "3",

}

TY - JOUR

T1 - A comparison of the National Ambulatory Medical Care Survey (NAMCS) measurement approach with direct observation of outpatient visits

AU - Gilchrist, Valerie J.

AU - Stange, Kurt C.

AU - Flocke, Sue

AU - McCord, Gary

AU - Bourguet, Claire C.

PY - 2004/3/1

Y1 - 2004/3/1

N2 - Background: The National Ambulatory Medical Care Survey (NAMCS) informs a wide range of important policy and clinical decisions by providing nationally representative data about outpatient practice. However, the validity of the NAMCS methods has not been compared with a reference standard. Methods: Office visits of 549 patients visiting 30 family physicians in Northeastern Ohio were observed by trained research nurses. Visit content measured by direct observation was compared with data reported by physicians using the 1993 NAMCS form. Results: Outpatient visit physician reports of procedures and examinations using the NAMCS method showed generally good concordance with direct observation measures, with kappas ranging from 0.39 for ordering a chest x-ray to 0.86 for performance of Pap smears. Concordance was generally lower for health behavior counseling, with kappas ranging from 0.21 for alcohol counseling to 0.60 for smoking cessation advice. The NAMCS form had high specificity (range, 0.90-0.99) but variable (range, 0.12-.84) sensitivity compared with direct observation, with the lowest sensitivities for health behavior counseling. The NAMCS physician report method overestimated visit duration in comparison with direct observation (16.5 vs. 12.8 minutes). Conclusions: Compared with direct observation of outpatient visits, the NAMCS physician report method is more accurate for procedures and examinations than for health behavior counseling. Underreporting of behavioral counseling and overreporting of visit duration should lead to caution in interpreting findings based on these variables.

AB - Background: The National Ambulatory Medical Care Survey (NAMCS) informs a wide range of important policy and clinical decisions by providing nationally representative data about outpatient practice. However, the validity of the NAMCS methods has not been compared with a reference standard. Methods: Office visits of 549 patients visiting 30 family physicians in Northeastern Ohio were observed by trained research nurses. Visit content measured by direct observation was compared with data reported by physicians using the 1993 NAMCS form. Results: Outpatient visit physician reports of procedures and examinations using the NAMCS method showed generally good concordance with direct observation measures, with kappas ranging from 0.39 for ordering a chest x-ray to 0.86 for performance of Pap smears. Concordance was generally lower for health behavior counseling, with kappas ranging from 0.21 for alcohol counseling to 0.60 for smoking cessation advice. The NAMCS form had high specificity (range, 0.90-0.99) but variable (range, 0.12-.84) sensitivity compared with direct observation, with the lowest sensitivities for health behavior counseling. The NAMCS physician report method overestimated visit duration in comparison with direct observation (16.5 vs. 12.8 minutes). Conclusions: Compared with direct observation of outpatient visits, the NAMCS physician report method is more accurate for procedures and examinations than for health behavior counseling. Underreporting of behavioral counseling and overreporting of visit duration should lead to caution in interpreting findings based on these variables.

KW - Ambulatory care

KW - Direct observation

KW - NAMCS

KW - Primary care

KW - Validity and reliability

UR - http://www.scopus.com/inward/record.url?scp=2142642353&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=2142642353&partnerID=8YFLogxK

U2 - 10.1097/01.mlr.0000114916.95639.af

DO - 10.1097/01.mlr.0000114916.95639.af

M3 - Review article

VL - 42

SP - 276

EP - 280

JO - Medical Care

JF - Medical Care

SN - 0025-7079

IS - 3

ER -