What do red wine, cell phones, and daycare have in common? All have ambiguous links to human health established by epidemiological, or observational, studies. The list of dietary, consumer, and lifestyle choices that can affect wellbeing is long; anybody who reads the morning paper or watches the evening news knows this. Journalists and the public have an insatiable appetite for usable science.
Scientifically speaking, however, the effects of dietary, consumer, and lifestyle choices are often poorly understood. This isn’t such a bad thing; uncertainty is a natural part of the scientific process. But journalists and the public often do not understand the general structure and process of medical research studies, let alone the role uncertainty plays in them.
One reason for this is the difficulty reporters have getting generalized, wide-angle stories about science into print. But last weekend The New York Times Magazine cover story was an exposé on the state of epidemiology, under the headline: “Do we really know what makes us healthy?” The answer, obviously, is that we usually do not. “Much of what we’re told about diet, lifestyle and disease is based on epidemiologic studies,” writes Gary Taubes, the author of the Times piece. “What if it is just bad science?”
Epidemiologists study disease patterns (think epidemics) and dietary, consumer, and lifestyle choices within or between large populations. Based on those studies, they try to make inferences about both causes of and ways to prevent chronic illnesses like cancer, heart disease, or asthma. The biggest limitation of these observational studies - as people familiar with them, but few others, well know - is that they can distinguish association between activities or events and diseases, but they can never determine causation. “Testing these hypotheses in any definitive way requires a randomized-controlled trial,” writes Taubes. Such laboratory-based experiments, also known as clinical trials, are the “gold standard” of medical research.
Often, clinical trials will refute the hypotheses of observational studies by reaching entirely different conclusions. Some critics say that “more than half” of the observational studies are incorrect, according to a Monday article in the Los Angeles Times that was very similar to Taubes’ piece. Both pieces compare the weaknesses of epidemiology to the strengths of clinical trials, and leave the reader with the impression that the former is simply bad science.
The problem, Taubes writes, is that because observational studies “can generate an enormous number of speculations about causes or prevention of chronic diseases, they provide the fodder for much of the health news that appears in the media.” In other words, the health-news craze that has infected the press in recent decades demands definitive stories, and science is often much too complicated for such black and white treatment. The consequence, notes Andreas von Bubnoff, who wrote the Los Angeles Times article, is that “often, in response to them, members of the public will go out and dose themselves with this vitamin or that foodstuff.” The “dangerous game,” as Taubes describes it, of the “presumption of preventive medicine.”