Video 2 of 7
Ecological studies
When the data exist only for groups, the unit of analysis becomes the group. What makes a study ecological, when it is the right tool, and the ecological fallacy, worked through Robinson’s 1950 analysis of literacy in the 1930 U.S. Census.
3:22 · 8 slides · printable slides · transcript
Slides
Printable deck →▶Transcript8 sections
Generated from the narration script. Plain text version.
1In an ecological study, the unit of analysis is a group, like a country or a city, and not an individual.
2Here's a question we can't answer with individual-level data. Are countries with higher per-capita sugar consumption seeing more type 2 diabetes? We don't have anyone's sugar intake on file. What we have is national consumption per capita and national diabetes prevalence, both aggregate, so the unit of analysis becomes the country, not the person.
3That's an ecological study, an analysis where the unit of observation is a group, like a country, a city, a clinic, or a year. We give up depth and gain reach. We can compare hundreds of populations using data that's already been collected, but we can't say what's happening inside any one person.
4Ecological work shines when the exposure of interest is most naturally treated as a group-level property. Air quality, policy environments, health system capacity, and climate variables aren't individual attributes, they're contextual ones. Do countries with hotter average temperatures see more vector-borne disease? That's a natural country-level question, because climate is a property of places. Policy questions land in similar territory when a national rollout reaches everyone at once, though when a rollout phases in by region or eligibility threshold, we can often do better with individual-level data.
5The design also earns its keep when individual-level data are unavailable or expensive. Researchers studying cancer mortality across 343 Latin American cities mapped wide variation between cities, with overall rates differing by nearly threefold, and linked it to city-level socioeconomic development. That work would be impossible if it required individual medical records. The question is about places, not people.
6The danger has a name, the ecological fallacy. Group-level and individual-level associations don't have to agree. They can be weaker, stronger, or point in opposite directions. Confounding is one mechanism: wealthier countries eat more fish and also have better cardiac care. But aggregation itself can scramble the signal. A country mean averages over people who differ enormously in exposure and risk, and the relationship across means can look nothing like the relationship across individuals.
7The classic illustration comes from 1930 U.S. Census data. States with more foreign-born residents had markedly higher literacy rates, even though foreign-born individuals were only slightly less literate than native-born individuals. Aggregation didn't just flip the sign. It inflated a near-trivial individual difference into a powerful state-level pattern.
8Ecological designs let us ask questions at the scale exposures actually operate, like policy, geography, and climate, using data that already exist. They're inexpensive, fast, and well suited to global comparisons. The ecological fallacy is a permanent risk, and confounding is hard to address with aggregate data, because we can't adjust for individual-level covariates we don't have. Exposure and outcome are measured at a coarser resolution, which can mask variation within groups. Good ecological work frames its findings as hypotheses about populations, and treats them as a starting point for hypothesis generation and triangulation, not the last word on causation.