Whose pandemic strategy really saved lives? Which states or countries lost the most people to the virus? Or to the unintended consequences of mitigation efforts? Now there's finally some clear, objective data emerging from the fog.
The most telling statistic turns out to be the simplest: all-cause mortality. Tallies of who died, when and where can be used to calculate "excess mortality" — how many more people died in a given place and time period than would be expected. By contrast, official COVID-19 death statistics are clouded by differences in testing and a level of subjectivity doctors say is required to give a cause of death for people who had multiple health problems.
As early as the fall of 2020, statisticians were looking at all-cause mortality to try to figure out whether official COVID-19 deaths were overcounted or undercounted. But today, the death data are more complete, and cover enough time to make revealing comparisons between different periods and regions.
While researchers are still figuring out which factors swayed these death statistics, a few conclusions are becoming clear: First, that COVID has been a global tragedy, causing millions of deaths. Second, that vaccines have saved countless lives. And third, that during the omicron and delta waves, the value of any non-pharmaceutical mitigation measures — masking, distancing, closing businesses and schools — was probably not nothing, but vaccination rates mattered far, far more.
One recently released analysis, not yet peer reviewed, concluded that in the U.S. there were 1.17 million excess deaths from Mar. 1, 2020 to Feb. 28, 2022 — a death rate that's about 20% above the normal number of deaths (5,817,974) for that period. That's higher than the official COVID death count. Excess mortality "is the most agnostic metric because it doesn't ask you to make decisions," said Jeremy Faust, an emergency medicine doctor at Brigham and Women's hospital and co-author of the analysis. "It just asks you to say, are these deaths normal?"
Looking at excess death data has allowed Faust and his collaborators to examine deaths by time period, region, gender, age and race, all broken down into the five or six waves of the pandemic. "We were really looking to say not just how big is this problem, but where is this problem?" he said, "And what does that tell us about our society and how we are responding?"
For example, comparisons made by Faust's team across different counties in Massachusetts showed excess deaths clustered in areas with low vaccination rates. In their nationwide analysis, they found the South had the most excess deaths and the lowest vaccine uptake. (Whether you're comparing counties, states or countries, excess deaths shouldn't depend on factors such as population age or overall health because the statistic compares the actual number of deaths in each region with the typical number of deaths in that same region, said Yale cardiologist Harlan Krumholz, co-author of the preprint.)
Faust and his team was also able to show that Native Americans, Black and Hispanic Americans died in disproportionate numbers, and that men showed more excess deaths than women. And in a surprising twist, while many more elderly people died by sheer numbers, the rate of excess death was higher among people under 50. That is, the death rate among those under 50 was more abnormal than the deaths of those over 65.