At the same time, making database skills and training a priority can be tough for overburdened reporters and editors. Nor do journalism schools necessarily give such skills pride of place—in fact, many teach them piecemeal, if at all. At the graduate level, New York University requires students in its Science, Health, and Environmental Reporting (SHERP) concentration to obtain a solid grounding in numeracy. In other concentrations, however, these skills play a smaller role. The Columbia University Graduate School of Journalism offers a handful of relevant classes, including investigative reporting, a course called Evidence and Inference, and a new addition, Digital Media: Interactive Workshop, which stresses storytelling through data and interactive presentation. But there is no data course that all students must take in order to graduate. “We don’t require every student to know how to use Excel in the same way we require them to know how to use FinalCut Pro or a digital camera,” said Bill Grueskin, Dean of Academic Affairs at Columbia. As a result, many students remain stuck at control-f.
What Gilbert learned in Missouri turned out to be indispensable. He took his spreadsheets with him, and learned how to transfer the data from Excel to Microsoft Access, a database management program better suited to large searches. (Funnily enough, Gilbert actually had a copy of Access on his desktop back in Bristol; he just didn’t know what it was for.) And he absorbed a basic programming language called Structured Query Language, or SQL, which allowed him to search for specific patterns in his data.
Eventually, Gilbert got his data cleaned and organized enough to be able to write his fundamental query: Show me the accounts that correspond to wells where oil or gas has been produced, but royalties have not been paid. What he found was damning. “Of about 750 individual accounts in escrow, between 22 percent and 55 percent received no royalty payments during months when the corresponding wells produced gas over an 18-month period,” Gilbert wrote in the first of an eight-part series. As for royalty payments that had been made, $24 million was lying in escrow, in dispute. Over the course of the series, Gilbert explained the history of the dispute, took the state gas and oil board to task, and showed that citizens who were allegedly owed thousands were being told they were entitled to less than a dime. His series spurred the Virginia legislature to investigate ways to distribute the money in escrow to the people who own it. In April, Gilbert won the Pulitzer Prize for Public Service.
After the prize was announced, Foster told Gilbert that the Herald Courier had been hearing about the escrow fund and the government mismanagement for years. “Two prior managing editors had spiked the story,” Foster said. “Royalties, methane gas, escrow accounts—it’s not the sexiest story.” In these earlier cases, nobody had been able to break through the data roadblock. Gilbert, who moved to Houston in October to cover the oil and gas industry for The Wall Street Journal, says that he thought it was a “pretty good story” to begin with. “But the data changed it,” he adds. “Instead of just asking the question, I was able to answer it.”

Corporations of all sorts LOVE to drowned journalists and other with information then they can say "we gave it to them; it's their problem if they can't decipher it." SURE!!! Just like yesterday's report in Business, NY Times that Microsoft, and Google earlier, had placed their information for news and/or income/profits/losses etc on THEIR own site but didn't bother to give it to anyone else. So if one wants to find out, he/she has to go to each site for the subject which may not be on the same headline or algorithm. That works only to the advantage of the company not to those needing the information. It's so much like Mr Murdoch's action of requiring that all his papers MUST only be on Microsoft's Explorer. So though I usually use Firefox for easier reading and copying, if something comes up for TLS his supplement for Times of London he will let one see it but to copy it--if I can find it--I must switch to Explorer and hope it's being listed. They have an archive but it's "being upgraded"--has been for 11 months. I hope it's good if it makes it up online. Murdoch would rather get rid of TLS since it has heavier articles than the kind he likes but since he gains so much flack when he suggests doing it from all 6 continents, he backs off. The SEC misworded a regulation and it has backfired in terms of corporation listings. W/ the new Republican House who's going to get these changed and corrected??
#1 Posted by Patricia Wilson, CJR on Wed 10 Nov 2010 at 05:19 PM
Before contemplating anything like the techniques you outline, reporters need to learn to hand simple single numbers or a handful of numbers. My favorite example is unemployment data. Most reporters are content to use the government's unrealistically low U3 measure, while at the same time the government releases the much more realistic U6 number. And these same reporters have no sense of month to month fluctuations in the numbers, whether the magnitude is significantly greater than chance, and the fact the phenomenon is not stationery but increasing as population rapidly increases. Even regular economic beat reporters for media like the NYTimes take this approach. And I don't know what it takes to wake them up. Certainly readers like myself regularly provide feedback to no effect.
#2 Posted by Bob Richardson, CJR on Wed 10 Nov 2010 at 06:05 PM