Here’s a good example of how corrections can fail to fix misimpressions created by the original error. In this case, the misimpression is the premise of the story, which ran on the front of The Wall Street Journal’s Money & Investing section on Friday.
Here’s the headline:
Raters Fail to See Defaults Coming
History Shows Firms Rarely Anticipate Sovereign Failures
What’s the Journal’s main piece of evidence (emphasis mine)?
Out of the 15 government defaults S&P has tracked since 1975, for instance, the firm rated 12 of the countries single-B or higher one year before the event. Yet S&P says a single-B rating has just a 2% average chance of default within a year. Put another way, S&P drastically underestimated one-year default risk in 80% of those cases.
First, it’s strange that the Journal says that raters fail to see sovereign defaults coming when it talks primarily about single B ratings, which are well into junk territory. Junk bonds by definition imply a much higher risk of default than investment-grade bonds.
But the Journal erred by misconstruing what S&P actually said and basing its whole story on it. Here’s its correction from Monday’s paper (emphasis):
Standard & Poor’s Corp. says that historically, a single-B rating on sovereign debt has had just a 2% average default rate within a year. A Friday Money & Investing article about sovereign-debt ratings incorrectly stated that S&P says single-B ratings have a 2% chance of defaulting within a year.
It took me a few minutes to wrap my head around the difference here, and that’s after a very alert reader pointed it out to me (thanks, very alert reader!). The problem is that S&P doesn’t predict that individual single-B countries have a 2 percent chance of defaulting within a year. It instead says just 2 percent of countries have defaulted within a year of having a single-B. In other words, the Journal’s entire story is negated by this one subtle change of meaning.
In fact the real numbers show the opposite of what the Journal told us. The 2 percent default number shows that countries rated single-B rarely default in the near term.
Worse, the paper just wrote through its story online, dropping the correction at the bottom of the page. Here’s how it reads now:
Out of the 15 government defaults S&P has tracked since 1975, for instance, the firm rated 12 of the countries single-B or higher one year before the event. Yet S&P says historically, a single-B rating on sovereign debt has had just a 2% average default rate within a year. Put another way, S&P drastically underestimated one-year default risk in 80% of those cases
But this is still not right. The S&P numbers, if the Journal correction is itself correct, were historical statistics, not forecasts of a 2 percent likelihood of default. Even if they were predictions, S&P would by definition be correct in a 2 percent chance forecast, since 2 percent of countries so rated have defaulted.
The Journal’s accompanying graphic is also misleading. It reads:
Missing the Boat
A year before the following government-debt defaults, credit ratings indicated a low chance of such an event.
Junk bond ratings indicate an elevated risk of default. I’m no fan of the credit raters and you could make a case that these soon-to-default countries should have been rated even lower than single-B, like, say, . But that’s not the case Journal made.
Unless you happened to read the corrections page three days after the story ran and scratched your head long enough to figure out what the correction meant, you don’t know that the Journal got the whole story wrong. The correction implies that it just parsed some words incorrectly.
You can see how easy it would have been to make this mistake. We all make embarrassing ones, but the Journal’s correction isn’t good enough. Readers need to know when errors compromise the basic thesis of the story.

How about "correcting" a story without correcting it, which seems to me to be even more craven. The totality of The NYT coverage of Harbottle & Lewis and News Corp (in news articles and at The Lede) would make for a fascinating study:
The Independent on Sunday: Lawyers 'furious' over criticism in hacking scandal By James Hanning and Matt Chorley 31 July 2011
[The Murdoch claims have infuriated Harbottle & Lewis so much that some senior figures at the firm are understood to have discussed taking legal action for defamation...
Yesterday, The New York Times (NYT) reported that both NI and Harbottle were clearly aware of the contents of the emails when the exculpatory letter was written. According to the paper, in one email Clive Goodman warns that those involved could "go to prison for this"...
There was, according to The NYT, citing sources familiar with the incidents, "huge anxiety" about the precise wording. NI urged the law firm to write a letter giving it a clean bill of health in the strongest possible terms. Jon Chapman, NI's head of legal affairs, reportedly rejected two earlier drafts as being insufficiently broad... Another Harbottle source added: "If we made any mistakes, we will hold our hands up, but we are extremely keen to protect our reputation and we will vigorously challenge any suggestion that we were in any sort of cahoots with News International."]
#1 Posted by Clayton Burns, CJR on Wed 17 Aug 2011 at 04:48 PM
Clayton,
I'm unclear what you're suggesting the NYT needs to correct. The emails released yesterday by the parliamentary committee back up the report mentioned here.
#2 Posted by Ryan Chittum, CJR on Wed 17 Aug 2011 at 06:53 PM
Yep, that AA rating is way too kind. Junk is more like it.
#3 Posted by Dan A., CJR on Wed 17 Aug 2011 at 07:21 PM
I'm not a Journal subscriber and can't see all the underlying article, so maybe I'm missing some context, but even if they had explained the difference between a prediction and historical probability, the test they're using seems ridiculous. Why would they only look at the credit rating from the previous year to categorize defaults, but use the annualized rate of default for all B bonds over the whole period of observation? Having 75% of your B bonds default in a year when it should be 2% would be ridiculous, but the 2% figure is derived from much longer observations. If a country were ranked B for all 36 years since 1975, then the 2%/annum default risk would mean that the chance of it defaulting would be more than 50/50. Not the same as 12 out of 15, but much closer than the 2% figure they quote. Obviously a lot of silly assumptions on both my and The Journal's part there, but you see what I mean. They used a ridiculous comparison to advance a thesis that the real statisticians (http://rortybomb.wordpress.com/2011/07/24/the-activist-ratings-agencies-and-their-poor-public-sector-predictions/) seem to have rejected. Really calling the figure a prediction when it wasn't was the smaller problem with that number, the bigger one is that it was a rate drawn from decades of observations that they tried to compare to only the years when default actually occurred.
#4 Posted by Xiafang, CJR on Wed 17 Aug 2011 at 09:37 PM
Ryan, Sorry about not responding earlier, but I have been working with a student. The NYT story I strongly objected to is this one (I include a couple of potentially misleading paragraphs):
July 29, 2011 2007 Letter Clearing a Tabloid Comes Under Scrutiny
By JO BECKER and DON VAN NATTA Jr.
[The two people familiar with internal discussions between News International and the firm, who spoke on the condition of anonymity given the criminal investigations, said company executives urged Harbottle & Lewis to write a letter giving News International a clean bill of health in the strongest possible terms. [...]
The company rejected earlier drafts by Harbottle & Lewis that were not as broad, according to the two people with access to the correspondence. One of them said that lawyers on both sides seemed to struggle to find language that said the review had found no evidence of wrongdoing.
“They wanted to bury those e-mails, and they wanted Harbottle & Lewis to give them a letter to indicate there was nothing incriminating in the file,” said one of the people who reviewed the exchanges. “They knew exactly what they were doing.”]
The last two paragraphs paint a picture of broad collusion that Harbottle & Lewis objected to (furiously) in my first comment above. In the aftermath of the latest document releases, the reaction has been to condemn News Corp for its definition of H&L's role. Not to condemn H&L for collusion.
As usual, so as to avoid conspiracy theories, I won't mention that there was some mysterious fiddling at The NYT site re my comment on The Independent on Sunday story above. I have notified The NYT Public Editor about that.
#5 Posted by Clayton Burns, CJR on Wed 17 Aug 2011 at 11:36 PM
Ryan, The Lede here goes around the JO BECKER and DON VAN NATTA Jr. "scoop:" "Letter Clearing a Tabloid Comes Under Scrutiny." That is what I meant by the evasion of leaving mistaken text uncorrected:
NYT The Lede August 16, 2011, 10:49 AM
Letter Raises New Questions About Internal Inquiry at Tabloid
By ROBERT MACKEY [...]
[As The Lede noted last month, in a post that contained the full text of the letter Harbottle & Lewis provided to News International in 2007, it seems clear now that the law firm was instructed to look through the e-mail correspondence only for evidence that Mr. Goodman’s superiors knew about the phone hacking that informed his articles, or that others at the paper were doing also using the technique. Harbottle & Lewis was not, apparently, asked to look for evidence of other kinds of illegal activity, like payments to the police, or given access to e-mails sent by other reporters at the paper, like one that contained a transcript of 35 hacked voice mail messages.]
#6 Posted by Clayton Burns, CJR on Wed 17 Aug 2011 at 11:57 PM
If the American public knew the extent to which the columbia school of journalism is implicated in a socialist agenda to destroy america......the entire program would be burnt to the ground. of course, we all know that won't happen. Or will it?
suibne
#7 Posted by suibne, CJR on Thu 18 Aug 2011 at 02:01 PM
Wow, can someone please moderate the shizz out of suibne? Troll, you die.
Otherwise, fascinating article. I'm still wrapping my head around what that difference in wording (/facts) implies, but maybe that's just end-of-day bleariness.
#8 Posted by leilani, CJR on Thu 18 Aug 2011 at 07:28 PM
"Otherwise, fascinating article. I'm still wrapping my head around what that difference in wording (/facts) implies, but maybe that's just end-of-day bleariness."
What it means is that, under normal circumstances, 2% of countries default and that is because countries, in general, are loath to default. Usually some IMF bailout package or debt restructuring, accompanied by some very savage austerity, is used in place of default.
However, these are not normal circumstances and the bail out capacities of the world economy are being stretched as far as they can go, therefore the single B now implies alot more risk of default than the single B in the past. The same thing happened with CDO's when risk assessments were being issued on the historical performance of tranches and not the quality of products themselves. Under normal circumstances, the Asset Backed Securities had a predictable default rate and a predictable risk. When underwriting standards fell, the old assumptions under "normal" circumstances failed. Those who didn't adjust their assumptions and reassess their risk lost alot of money.
#9 Posted by Thimbles, CJR on Fri 19 Aug 2011 at 12:28 AM