Video 1 of 6
Causal deniability
A large study of coffee drinkers reported a 5% lower risk of dying, stated plainly that it could not establish cause and effect, and then suggested people drink coffee for their health. Naming that move, and the three conditions for demonstrating causality.
8:00 · 14 slides · printable slides · transcript
Slides
Printable deck →▶Transcript14 sections
Generated from the narration script. Plain text version.
1This video is about causal inference: what we do when we identify and estimate the causal effect of some proposed cause on an outcome of interest. We'll build up a working definition of a cause, and end on the property a study needs before anyone should believe a causal claim it makes. We start with coffee.
2Extra! Extra! Read all about it. New study suggests coffee could literally be a lifesaver. This is a real headline about a study published in the journal Circulation. Now, I'm as big a coffee fan as the next guy, but literally a lifesaver? Here is what the study authors wrote in their paper. Higher consumption of total coffee, caffeinated coffee, and decaffeinated coffee was associated with lower risk of total mortality. Relative to no consumption of coffee, the pooled hazard ratio for death was zero point nine five, with a ninety-five percent confidence interval of zero point nine one to zero point nine nine, for one cup of total coffee per day or less.
3Associated with tells us that there's a relationship between mortality and coffee consumption in the observed data. The sort of people who drink a cup of coffee daily have a five percent lower risk of dying over two to three decades. That's a hazard ratio, so it's a relative comparison. By my own back of the envelope analysis, it works out to about a zero point seven percent absolute decrease in the incidence of mortality. Does this mean that coffee prevents death? The study authors say no. But also, maybe.
4Here is how causal deniability works, in two steps, both of them from the same paper. Step one: avoid the word causal, and warn that correlation is not causation. In their words, given the observational nature of the study design, we could not directly establish a cause-effect relationship between coffee and mortality. Step two: ignore the warning, and make policy or health recommendations based on a causal interpretation of the same findings. In their words, coffee consumption can be incorporated into a healthy lifestyle, and moderate consumption of coffee may confer health benefits in terms of reducing premature death. So which is it, a non-causal association or a causal effect?
5It has been argued that scientists need to stop the charade. Quote: we need to stop treating causal as a dirty word that respectable investigators do not say in public or put in print. It is true that observational studies cannot definitively prove causation, but this statement misses the point. And the point is that we have to be clear about our scientific goals, and use language that reflects those goals.
6To riff on that idea a bit. Do we want to determine whether the sort of people who drink a cup of coffee daily have a lower risk of dying, or do we want to determine whether drinking a cup of coffee daily lowers the risk of dying? It's almost always the latter. You might be interested in the first version if you are developing a prediction model. But to answer the second one, we need causal inference.
7Causal inference is what we do when we identify and estimate the causal effect of some proposed cause on an outcome of interest. We use causal inference methods in global health to answer key questions about health policy and practice. Do bed nets prevent malaria, and by how much? Is it better to subsidize bed nets or sell them at full retail cost? And so on.
8Causes, effects, and outcomes. The bed net question contains all three. Bed nets are the proposed cause. Malaria is the outcome of interest. And by how much is the effect.
9As someone who has likely perfected the art of causal inference in your daily life, you might be surprised to learn that causal inference in science is still a rapidly evolving field. You already know that putting your hand on a hot stove causes pain, and that your headache went away because you took ibuprofen. We make these kinds of causal judgments constantly, often without much conscious thought. Yet formalizing this intuitive process for scientific research, where we need to be precise about what we mean and defend our conclusions to skeptics, turns out to be remarkably challenging. Even core terms like cause and effect are up for debate.
10There are two kinds of causal question, and they are not equally tractable. The most common type we ask is about the effects of causes. What is the effect of X on Y? For instance, what is the effect of a new therapy on depression severity? Given a well-defined cause, X, we can estimate what happens to Y if we intervene to change X. Questions about the causes of effects, what causes Y, are harder to answer. For example, what causes depression?
11So what is a cause? A Turing Award-winning computer scientist and his co-author, a mathematician turned science writer, offered this definition in their two thousand eighteen book. Quote: a variable X is a cause of Y if Y listens to X and determines its value in response to what it hears. That definition has two key implications. First, causes must come before effects. X speaks, and then Y listens. Second, causes and effects are associated, meaning they go together, or covary. When X happens, Y is more likely to happen. More likely, because the effect does not always need to happen for there to be a causal relationship. Smoking increases the probability of developing lung cancer, but not all smokers will develop lung cancer. Most of the relationships we study in global health are like this. Probabilistic in nature, not deterministic.
12Here is a distinction that trips up a lot of students. A causal relationship can exist even when we can't cleanly identify it. Imagine smoking truly does cause lung cancer, but there's also some genetic factor that makes certain people both more likely to smoke and more susceptible to cancer. In that scenario, smoking still causes cancer. Y still listens to X. The confounding factor doesn't change the underlying causal relationship. It just makes it harder for us as researchers to measure how much of the cancer risk comes from smoking versus genetics. And that brings us to one of the central challenges in causal inference: ruling out plausible alternative explanations. During the smoking debate of the nineteen fifties and sixties, some proponents of smoking asked whether the apparent causal link could be explained by a smoking gene that predisposed people to both. Such a gene was in fact later discovered, and it does not explain the clear relationship between smoking and cancer. The question was never whether smoking could cause cancer; it was whether the evidence proved that it did.
13The need to rule out plausible alternative explanations keeps many researchers up at night. The conditions are usually put this way. We can only infer a causal relationship when, one, the cause preceded the effect. Two, the cause was related to the effect. And three, we can find no plausible alternative explanation for the effect other than the cause. Notice what that third condition is about. It's about identifying causal effects, what we need in order to demonstrate causation convincingly. Causation can exist in the world whether or not any particular study manages to demonstrate it. Studies that fail to rule out alternative explanations convincingly are characterized as having low internal validity. There is not a strong justification for inferring that the observed relationship between X and Y is causal, even if such a relationship truly exists.
14One last thing before we go. We study a variety of potential causes in global health research, and we call them by different names. Global mental health researchers develop and test interventions delivered to individuals or groups. Development agencies administer programs to improve people's well-being. Clinical researchers and biostatisticians test the efficacy of drugs and medical devices, generally referred to as treatments or therapies. Policy researchers and health economists study the impacts of policies, such as removing fees to deliver a baby at a public health facility. And epidemiologists estimate the effect of exposures, such as smoking, on the health status of a target population. Different words, same X. Next, we turn from causes to effects.