Estimating treatment effects with machine learning

K. John McConnell, Stephan Lindner

Research output: Contribution to journalArticle

Abstract

Objective: To demonstrate the performance of methodologies that include machine learning (ML) algorithms to estimate average treatment effects under the assumption of exogeneity (selection on observables). Data Sources: Simulated data and observational data on hospitalized adults. Study Design: We assessed the performance of several ML-based estimators, including Targeted Maximum Likelihood Estimation, Bayesian Additive Regression Trees, Causal Random Forests, Double Machine Learning, and Bayesian Causal Forests, applying these methods to simulated data as well as data on the effects of right heart catheterization. Principal Findings: In Monte Carlo studies, ML-based estimators generated estimates with smaller bias than traditional regression approaches, demonstrating substantial (69 percent-98 percent) bias reduction in some scenarios. Bayesian Causal Forests and Double Machine Learning were top performers, although all were sensitive to high dimensional (>150) sets of covariates. Conclusions: ML-based methods are promising methods for estimating treatment effects, allowing for the inclusion of many covariates and automating the search for nonlinearities and interactions among variables. We provide guidance and sample code for researchers interested in implementing these tools in their own empirical work.

Original languageEnglish (US)
JournalHealth Services Research
DOIs
Publication statusAccepted/In press - Jan 1 2019

    Fingerprint

Keywords

  • machine learning
  • observational research
  • treatment effects

ASJC Scopus subject areas

  • Health Policy

Cite this