Is regression discontinuity an instrument based method?

Frank Popham
2019-12-18

An instrument

This recent paper suggested that regression discontinuity is an instrument based method for causal inference. I am less sure. The paper contains an example of the form; what is the effect of university attendance on health?

Of course university attendance is not randomized, so an observational study has to deal with confounding. If university entry is based on an exam result cut-point then we can instrument on this, the paper suggests. The DAG below illustrates

Perhaps not?

But is exam an instrument? Well people from advantaged backgrounds do better in exams so there should be an arrow from confounding (C) to exam. Also exam results may effect health other than through university attendance so we need an arrow from exam to health. Usually the presence of either of these arrows negates the instrument. Their addition in the DAG below implies we need to adjust for confounding and exam to get the causal effect of university on health.

But this isn't quite right. Say exam result is the only way you can get into university then, as in the DAG below, confounding to university attendance runs through exam. Block exam and you can estimate the effect of university on health. As I have argued before, this design is more akin to Pearl’s front door criterion than an instrument. This is the way many regression discontinuity studies work.

They control for the underlying relationship between the forcing variable (exam here) and the health outcome, with the cut point of exam score for university providing the discontinuity from which the causal effect of university is estimated.

Randomized?

If there are a large number of observations just either side of the cut-point, then the DAG below could be assumed, where the arrow from exam to university is removed. The assumption being that random factors (performance on the day of the exam for example) at the border of the cut-point, essentially mean that university is randomized. However, usually we don’t have this number of observations so a wider range of observations is needed and the previous DAG applies.

So, I suggest that regression discontinuity isn’t an instrument method and is more front door based.

Of course some people may not go to university even if they achieve the entry score. In this situation the intervention is not fully determined by the forcing variable. Here regression discontinuity is an instrumental variable method as in the DAG below but not in the sense as outlined in the paper.

A highly cited review in economics also moves away from the instrument representation of regression discontinuity.

Thanks to…

I used R, and R Studio, and the tidyverse, daggity,

and ggdag functions to write this post.

Citation

For attribution, please cite this work as

Popham (2019, Dec. 18). Frank Popham: Is regression discontinuity an instrument based method?. Retrieved from https://www.frankpopham.com/posts/2019-12-18-is-regression-discontinuity-an-instrument-based-method/

BibTeX citation

@misc{popham2019is,
  author = {Popham, Frank},
  title = {Frank Popham: Is regression discontinuity an instrument based method?},
  url = {https://www.frankpopham.com/posts/2019-12-18-is-regression-discontinuity-an-instrument-based-method/},
  year = {2019}
}