Beyond inference by eye

Statistical and graphing practices in JEAB, 1992-2017

Elizabeth G.E. Kyonka, Suzanne Mitchell, Lewis A. Bizo

Research output: Contribution to journalArticle

Abstract

Debates about the utility of p values and correct ways to analyze data have inspired new guidelines on statistical inference by the American Psychological Association (APA) and changes in the way results are reported in other scientific journals, but their impact on the Journal of the Experimental Analysis of Behavior (JEAB) has not previously been evaluated. A content analysis of empirical articles published in JEAB between 1992 and 2017 investigated whether statistical and graphing practices changed during that time period. The likelihood that a JEAB article reported a null hypothesis significance test, included a confidence interval, or depicted at least one figure with error bars has increased over time. Features of graphs in JEAB, including the proportion depicting single-subject data, have not changed systematically during the same period. Statistics and graphing trends in JEAB largely paralleled those in mainstream psychology journals, but there was no evidence that changes to APA style had any direct impact on JEAB. In the future, the onus will continue to be on authors, reviewers and editors to ensure that statistical and graphing practices in JEAB continue to evolve without interfering with characteristics that set the journal apart from other scientific journals.

Original languageEnglish (US)
JournalJournal of the experimental analysis of behavior
DOIs
StatePublished - Jan 1 2019

Fingerprint

Guidelines
Confidence Intervals
Psychology

Keywords

  • confidence intervals
  • error bars
  • graphs
  • null hypothesis significance testing
  • statistical reform

ASJC Scopus subject areas

  • Experimental and Cognitive Psychology
  • Behavioral Neuroscience

Cite this

Beyond inference by eye : Statistical and graphing practices in JEAB, 1992-2017. / Kyonka, Elizabeth G.E.; Mitchell, Suzanne; Bizo, Lewis A.

In: Journal of the experimental analysis of behavior, 01.01.2019.

Research output: Contribution to journalArticle

@article{6fe9511578d64eb182f85ed84f763375,
title = "Beyond inference by eye: Statistical and graphing practices in JEAB, 1992-2017",
abstract = "Debates about the utility of p values and correct ways to analyze data have inspired new guidelines on statistical inference by the American Psychological Association (APA) and changes in the way results are reported in other scientific journals, but their impact on the Journal of the Experimental Analysis of Behavior (JEAB) has not previously been evaluated. A content analysis of empirical articles published in JEAB between 1992 and 2017 investigated whether statistical and graphing practices changed during that time period. The likelihood that a JEAB article reported a null hypothesis significance test, included a confidence interval, or depicted at least one figure with error bars has increased over time. Features of graphs in JEAB, including the proportion depicting single-subject data, have not changed systematically during the same period. Statistics and graphing trends in JEAB largely paralleled those in mainstream psychology journals, but there was no evidence that changes to APA style had any direct impact on JEAB. In the future, the onus will continue to be on authors, reviewers and editors to ensure that statistical and graphing practices in JEAB continue to evolve without interfering with characteristics that set the journal apart from other scientific journals.",
keywords = "confidence intervals, error bars, graphs, null hypothesis significance testing, statistical reform",
author = "Kyonka, {Elizabeth G.E.} and Suzanne Mitchell and Bizo, {Lewis A.}",
year = "2019",
month = "1",
day = "1",
doi = "10.1002/jeab.509",
language = "English (US)",
journal = "Journal of the Experimental Analysis of Behavior",
issn = "0022-5002",
publisher = "Society for the Experimental Analysis of Behavior Inc.",

}

TY - JOUR

T1 - Beyond inference by eye

T2 - Statistical and graphing practices in JEAB, 1992-2017

AU - Kyonka, Elizabeth G.E.

AU - Mitchell, Suzanne

AU - Bizo, Lewis A.

PY - 2019/1/1

Y1 - 2019/1/1

N2 - Debates about the utility of p values and correct ways to analyze data have inspired new guidelines on statistical inference by the American Psychological Association (APA) and changes in the way results are reported in other scientific journals, but their impact on the Journal of the Experimental Analysis of Behavior (JEAB) has not previously been evaluated. A content analysis of empirical articles published in JEAB between 1992 and 2017 investigated whether statistical and graphing practices changed during that time period. The likelihood that a JEAB article reported a null hypothesis significance test, included a confidence interval, or depicted at least one figure with error bars has increased over time. Features of graphs in JEAB, including the proportion depicting single-subject data, have not changed systematically during the same period. Statistics and graphing trends in JEAB largely paralleled those in mainstream psychology journals, but there was no evidence that changes to APA style had any direct impact on JEAB. In the future, the onus will continue to be on authors, reviewers and editors to ensure that statistical and graphing practices in JEAB continue to evolve without interfering with characteristics that set the journal apart from other scientific journals.

AB - Debates about the utility of p values and correct ways to analyze data have inspired new guidelines on statistical inference by the American Psychological Association (APA) and changes in the way results are reported in other scientific journals, but their impact on the Journal of the Experimental Analysis of Behavior (JEAB) has not previously been evaluated. A content analysis of empirical articles published in JEAB between 1992 and 2017 investigated whether statistical and graphing practices changed during that time period. The likelihood that a JEAB article reported a null hypothesis significance test, included a confidence interval, or depicted at least one figure with error bars has increased over time. Features of graphs in JEAB, including the proportion depicting single-subject data, have not changed systematically during the same period. Statistics and graphing trends in JEAB largely paralleled those in mainstream psychology journals, but there was no evidence that changes to APA style had any direct impact on JEAB. In the future, the onus will continue to be on authors, reviewers and editors to ensure that statistical and graphing practices in JEAB continue to evolve without interfering with characteristics that set the journal apart from other scientific journals.

KW - confidence intervals

KW - error bars

KW - graphs

KW - null hypothesis significance testing

KW - statistical reform

UR - http://www.scopus.com/inward/record.url?scp=85061433687&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=85061433687&partnerID=8YFLogxK

U2 - 10.1002/jeab.509

DO - 10.1002/jeab.509

M3 - Article

JO - Journal of the Experimental Analysis of Behavior

JF - Journal of the Experimental Analysis of Behavior

SN - 0022-5002

ER -