A study by the Massachusetts Institute of Technology’s Joint Program on the Science and Policy of Global Change, which found that end-of-the-century global warming could be twice as severe as previous estimates, drew a limited amount of press attention on Thursday. Few of the resulting articles, unfortunately, are totally satisfying.
One of the most conspicuous pieces was by USA Today’s Doyle Rice, who deserves credit for being one of the few reporters to seek outside, expert commentary on the study. But in the second paragraph, he flubs one of the study’s key statistics, writing:
The research, conducted by the Massachusetts Institute of Technology (MIT), predicts a 90% probability that worldwide surface temperatures will rise more than 9 degrees (F) by 2100, compared to a previous 2003 MIT study that forecast a rise of just over 4 degrees.
That’s inaccurate. According to the study, which was published this month in the American Meteorological Society’s Journal of Climate, that nine-degree (F) rise is actually the median probability of surface warming by 2100, meaning that there is an equal chance of the temperature increase falling above or below that value. There is a 90 percent probability that the increase will be between 6.3 and 13.3 degrees (F).
[Update - May 22, 3:00 p.m.: To understand why such minor gaffes can lead to major problems, read Judy Lowe’s explanation in The Christian Science Monitor of why “30 to 49 percent of people reading or hearing the news were going to be doubtful about some or all of it” in the first place. Or consider the recent Gallup survey, which found that many Americans think the media exaggerates global warming.]
One of the problems here is the word median. This is probably not a term with which most readers are familiar, and it really needs to be defined in every article where it appears. Take the second paragraph from Reuters article, for instance:
Earth’s median surface temperature could rise 9.3 degrees F (5.2 degrees C) by 2100, the scientists at the Massachusetts Institute of Technology found, compared to a 2003 study that projected a median temperature increase of 4.3 degrees F (2.4 degrees C).
Unlike in USA Today, that sentence is technically correct; and the most important upshot, that things are perhaps twice as bad as they seemed, is clear. But these are the only numbers in the short article—so how many readers would be able to decipher the full import of median? Given that there are fifty/fifty odds of the actual temperature rise falling above or below that value, one could have written, “Earth’s surface temperature could likely rise….” But even that would be misleading because the construction is far too deterministic. The real likelihood is best described by the probabilistic statement: there is a ninety-percent chance that the increase will be between 6.3 and 13.3 degrees F.
Journalists have a real problem with odds, however, in most cases preferring more definitive, newsy sounding statements. Take, for example, the Telegraph’s lede:
The study, carried out in unprecedented detail, projected that without “rapid and massive action” temperatures worldwide will increase by as much as 7.4C (13.3F) by 2100, from levels seen in 2000.
Referring to that absolute high-end value is “catchy,” but totally betrays the purpose of doing a probabilistic study. At the very least, the reporter should have noted that such an extreme temperature rise is not the most likely outcome—according to the paper, there is fifteen-percent probability that the increase will be between six and seven degrees C. It’s not until the bottom of the story that the reporter gets around to the central conclusion:
The projections average out at a likely Earth temperature increase of 5.2C (9.4F) this century, and conclude there is a 90 per cent chance the temperature change will be between 3.5C and 7.4C (6.3F and 13.3F).