Video 1 of 6

What descriptive designs can and cannot tell us

In June 1981 a report described five young men in Los Angeles with a rare pneumonia, and case reports, case series and surveillance went on to establish how a new disease spread long before any trial was possible. What descriptive designs can and cannot establish, with microcephaly after Zika in Pernambuco, Ebola contact tracing, polio surveillance in India and IDSR in sub-Saharan Africa.

7:16 · 16 slides · printable slides · transcript

Slides

Printable deck →

What descriptive designs can and cannot tell us

1 / 16
▶Transcript16 sections

Generated from the narration script. Plain text version.

1This chapter is about the full range of observational designs, from case reports that first raise the alarm to cohort studies that follow thousands of people over years. We'll start with the descriptive designs.

2On June 5, 1981, the CDC's Morbidity and Mortality Weekly Report published a brief notice about five young men in Los Angeles, all previously healthy, all hospitalized with Pneumocystis carinii pneumonia. Two of them had already died. The lead author, an immunologist at UCLA named Michael Gottlieb, had no idea what was killing them, but he knew the pattern was wrong. This was a disease of profoundly immunocompromised patients, not men in their twenties and thirties.

3A month later, the same weekly report described a cancer that is normally rare in the United States, diagnosed in 26 homosexual men, 20 of them in New York City and six in California, over the previous 30 months. By September, The Lancet had described eight more cases in New York. Neither the virus nor a name for the syndrome existed yet. The alarm had been sounded by physicians paying attention and documenting what they observed.

4The case reports were only the start. CDC investigators then completed a case-control study comparing men with that cancer or Pneumocystis pneumonia to matched controls. They couldn't name the agent, but they could say it was sexually transmitted, and that conclusion shaped the public health response. Cohort studies took over once an antibody test became available. A six-year follow-up of men in San Francisco mapped seroconversion, latency, and progression to AIDS. By the time the first randomized trial of AZT was published, observational research had already established that HIV caused AIDS, how it spread, and who was most affected.

5Most global health research works this way. If you've been taught that randomized trials sit at the top of the evidence hierarchy, you might see observational studies as what we settle for when we can't randomize. That undersells them. Observational designs are often the right tool for the question, and sometimes the only tool that's ethical, feasible, or fast enough to matter.

6And despite rumors to the contrary, causal inference is very much possible with observational data. In our session on causal inference, we introduced two strategies: confounder control, which closes backdoor paths through statistical adjustment, and design-based approaches, which isolate exogenous variation. The quasi-experimental designs focus on the second. This chapter is about the first.

7In 2015, physicians in Pernambuco State, Brazil, noticed that women were giving birth to babies with unusually small heads, a condition called microcephaly. From January to July, the state recorded 6 cases. Then it recorded 6 cases during August, 11 during September, and 39 during October. By early December, Brazil was receiving 900 reports of suspected microcephaly in a single week. This wasn't a formal study with a protocol. It was doctors recognizing a pattern that shouldn't exist, and their observations triggered Brazil's national emergency response and eventually connected the dots to Zika virus.

8Case reports describe individual patients or events. Case series describe a group of patients with a shared characteristic, like babies born with microcephaly in the same region and time period. They're the simplest form of observational research, and they're valuable for exactly one thing: noticing unusual patterns and generating hypotheses.

9Case series alert the medical community to new diseases, identify rare adverse effects of treatments, and describe the clinical features of novel conditions. The Zika case series generated the hypothesis that the virus caused microcephaly. But case reports can't tell us how common something is, because they have no denominator. They can't prove causation, because they have no comparison group. And they can't rule out confounding. For all of that, we need different designs.

10Researchers still needed to estimate the actual risk. Surveillance data on live births and microcephaly notifications put the risk of microcephaly after Zika infection ranged from 0.03% to 3.42% depending on the region. The high end is more than 100 times the low end. At the low end, about 1 of every 3,300 Zika-exposed pregnancies would result in microcephaly. At the high end, about 1 of every 29. If you're a pregnant woman exposed to Zika, you need to know which end of that range applies to you.

11The geographic variation itself became a clue. Why would risk vary so much across Brazilian states? Several hypotheses emerged: differences in virus strains, co-infections with other viruses, environmental cofactors, or even differences in case ascertainment and surveillance intensity. Each possibility required a different analytical design to investigate. That's exactly the kind of hypothesis that case series generate but can't test.

12This uncertainty spurred emergency responses well before precise estimates were available. Public health authorities declared a national emergency, developed protocols for suspected cases, and updated guidance for pregnant women. The initial case series didn't need to be perfect. It needed to be timely and credible enough to sound the alarm. When time matters in an emerging outbreak, rapid detection trumps precise estimation.

13If case reports are spotting individual canaries, public health surveillance is monitoring the entire coal mine, systematically and continuously. Surveillance systems track disease occurrence in populations over time, often using standardized case definitions and reporting procedures. They're not research studies in the traditional sense, but they generate the data that makes population-level research possible.

14During the 2014 to 2015 Ebola virus disease crisis, contact tracing was initiated for 26.7% of total cases, and it detected 3.6% of new cases. Contact monitoring succeeded 88% of the time, though this varied substantially between urban and rural districts. These numbers might seem modest, but they improved over time as teams learned what worked, and that learning was possible only through systematic surveillance documentation.

15The National Polio Surveillance Project in Uttar Pradesh, India, tracked acute flaccid paralysis cases and vaccination coverage. It was ongoing surveillance integrated into program implementation, and it contributed to India's success in eliminating wild polio. Across sub-Saharan Africa, the Integrated Disease Surveillance and Response strategy engages community health workers as frontline disease detectors, with district and national offices verifying, analyzing, and responding. When communities see that their reports lead to actual responses, they stay engaged. When they don't, the system degrades.

16What distinguishes surveillance from other observational designs is that it's continuous, population-based, standardized, and designed to trigger public health responses. But it shares the same fundamental limitation as case series. It describes what's happening, but it can't tell us why. For that, we need analytical designs.

Descriptive EpidemiologyCase SeriesSurveillanceHIV