Reliability and validity of observer ratings of neighborhoods

Elena Andresen, Theodore K. Malmstrom, Douglas K. Miller, Fredric D. Wolinsky

Research output: Contribution to journalArticle

20 Citations (Scopus)

Abstract

Objectives: The objectives were to examine the validity and reliability of a five-item neighborhood measurement scale. Methods: Respondents were enrolled from two catchment areas: a poor inner city and a heterogeneous suburban area. Items combine for a total score of 5 (best) to 20 (worst). The authors compared scales across catchment areas and respondent ratings and assessed interviewer effects and retest reliability. Results: Suburban neighborhood scale scores were 3 points lower (higher socioeconomic status, SES) than the inner-city scores. There was a strong relationship between scores and participants' neighborhood ratings. The retest correlation was substantial (.81), but only two of five items achieved kappas above .75. In regression models, interviewer experience and residence and individual interviewers contributed to different ratings, although there was still a marked difference between catchment areas. Discussion: Observer ratings of neighborhoods show promise as a measure of neighborhood SES, despite problems with interviewer effects. Future work should improve objective criteria for ratings.

Original languageEnglish (US)
Pages (from-to)28-36
Number of pages9
JournalJournal of Aging and Health
Volume18
Issue number1
DOIs
StatePublished - Feb 2006
Externally publishedYes

Fingerprint

Reproducibility of Results
rating
reactivity effect
Epidemiologic Effect Modifiers
Social Class
social status
Interviews
interview
regression
experience
Surveys and Questionnaires

Keywords

  • African American
  • Questionnaire
  • Reproducibility
  • Residence characteristics
  • Socioeconomic factors

ASJC Scopus subject areas

  • Geriatrics and Gerontology
  • Aging
  • Health(social science)
  • Health Professions(all)

Cite this

Reliability and validity of observer ratings of neighborhoods. / Andresen, Elena; Malmstrom, Theodore K.; Miller, Douglas K.; Wolinsky, Fredric D.

In: Journal of Aging and Health, Vol. 18, No. 1, 02.2006, p. 28-36.

Research output: Contribution to journalArticle

Andresen, Elena ; Malmstrom, Theodore K. ; Miller, Douglas K. ; Wolinsky, Fredric D. / Reliability and validity of observer ratings of neighborhoods. In: Journal of Aging and Health. 2006 ; Vol. 18, No. 1. pp. 28-36.
@article{be311374a9014929adf83022da671d47,
title = "Reliability and validity of observer ratings of neighborhoods",
abstract = "Objectives: The objectives were to examine the validity and reliability of a five-item neighborhood measurement scale. Methods: Respondents were enrolled from two catchment areas: a poor inner city and a heterogeneous suburban area. Items combine for a total score of 5 (best) to 20 (worst). The authors compared scales across catchment areas and respondent ratings and assessed interviewer effects and retest reliability. Results: Suburban neighborhood scale scores were 3 points lower (higher socioeconomic status, SES) than the inner-city scores. There was a strong relationship between scores and participants' neighborhood ratings. The retest correlation was substantial (.81), but only two of five items achieved kappas above .75. In regression models, interviewer experience and residence and individual interviewers contributed to different ratings, although there was still a marked difference between catchment areas. Discussion: Observer ratings of neighborhoods show promise as a measure of neighborhood SES, despite problems with interviewer effects. Future work should improve objective criteria for ratings.",
keywords = "African American, Questionnaire, Reproducibility, Residence characteristics, Socioeconomic factors",
author = "Elena Andresen and Malmstrom, {Theodore K.} and Miller, {Douglas K.} and Wolinsky, {Fredric D.}",
year = "2006",
month = "2",
doi = "10.1177/0898264305281001",
language = "English (US)",
volume = "18",
pages = "28--36",
journal = "Journal of Aging and Health",
issn = "0898-2643",
publisher = "SAGE Publications Inc.",
number = "1",

}

TY - JOUR

T1 - Reliability and validity of observer ratings of neighborhoods

AU - Andresen, Elena

AU - Malmstrom, Theodore K.

AU - Miller, Douglas K.

AU - Wolinsky, Fredric D.

PY - 2006/2

Y1 - 2006/2

N2 - Objectives: The objectives were to examine the validity and reliability of a five-item neighborhood measurement scale. Methods: Respondents were enrolled from two catchment areas: a poor inner city and a heterogeneous suburban area. Items combine for a total score of 5 (best) to 20 (worst). The authors compared scales across catchment areas and respondent ratings and assessed interviewer effects and retest reliability. Results: Suburban neighborhood scale scores were 3 points lower (higher socioeconomic status, SES) than the inner-city scores. There was a strong relationship between scores and participants' neighborhood ratings. The retest correlation was substantial (.81), but only two of five items achieved kappas above .75. In regression models, interviewer experience and residence and individual interviewers contributed to different ratings, although there was still a marked difference between catchment areas. Discussion: Observer ratings of neighborhoods show promise as a measure of neighborhood SES, despite problems with interviewer effects. Future work should improve objective criteria for ratings.

AB - Objectives: The objectives were to examine the validity and reliability of a five-item neighborhood measurement scale. Methods: Respondents were enrolled from two catchment areas: a poor inner city and a heterogeneous suburban area. Items combine for a total score of 5 (best) to 20 (worst). The authors compared scales across catchment areas and respondent ratings and assessed interviewer effects and retest reliability. Results: Suburban neighborhood scale scores were 3 points lower (higher socioeconomic status, SES) than the inner-city scores. There was a strong relationship between scores and participants' neighborhood ratings. The retest correlation was substantial (.81), but only two of five items achieved kappas above .75. In regression models, interviewer experience and residence and individual interviewers contributed to different ratings, although there was still a marked difference between catchment areas. Discussion: Observer ratings of neighborhoods show promise as a measure of neighborhood SES, despite problems with interviewer effects. Future work should improve objective criteria for ratings.

KW - African American

KW - Questionnaire

KW - Reproducibility

KW - Residence characteristics

KW - Socioeconomic factors

UR - http://www.scopus.com/inward/record.url?scp=30744472157&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=30744472157&partnerID=8YFLogxK

U2 - 10.1177/0898264305281001

DO - 10.1177/0898264305281001

M3 - Article

VL - 18

SP - 28

EP - 36

JO - Journal of Aging and Health

JF - Journal of Aging and Health

SN - 0898-2643

IS - 1

ER -