Editor’s note: This piece begins with journalist Sohrab Ahmari’s criticisms of Justin D. Martin’s recent article. Martin’s response comes next, then Ahmari closes it out with a response of his own.
In recent years, the Columbia Journalism Review has devoted special attention to the use and misuse of statistics in American journalism, taking reporters to task when they have fallen for unreliable statistics or failed to seek the human stories behind data. The cover essay in the March/April 2011 issue, for example, harshly criticized the Los Angeles Times for publishing the names of thousands of public school teachers next to their “value-added” performance data without giving readers sufficient context to interpret these numbers. In its next issue, CJR lauded an alternative weekly reporter for exposing the faulty methodology behind wildly alarming sex trafficking statistics that were uncritically picked up by a number of regional broadsheets. Such instances of statistical credulity and probity on the part of journalists regularly earn “darts” and “laurels” in the pages of CJR.
Such efforts are admirable. But they also require CJR to be doubly cautious in its own use of statistics. On April 2, columnist Justin Martin posted an article on the CJR website purporting to spotlight the twelve countries with the most number of journalists jailed “per capita.” Save for the conspicuous absence of China, the resulting list of authoritarian and quasi-authoritarian states was mostly predictable. But one country stood out from the rest: Israel. The Jewish state, according to Mr. Martin, jails more journalists per capita than the Islamic Republic of Iran, the Ba’athist regime in Syria, and the Burmese junta, among others. Only Eritrea, Mr. Martin claimed, jails more reporters per capita.
These are arresting rankings. The Committee to Protect Journalists, whose annual report provided Mr. Martin with the raw count of total journalists jailed per country, identifies Iran as the world’s worst jailor of journalists. How did Eritrea, let alone Israel, with its famously rowdy press and print culture, “beat” the Iranian mullahs to first and second place, respectively? Mr. Martin, a journalism professor at the University of Maine, quickly glossed over his own methodology and spent most of his piece drawing political conclusions from the data. Although “the Islamic Republic is up there,” he wrote, “Eritrea and Israel also need to do some explaining.” But Israel was deemed especially blameworthy: “Israel wants to be called a modern democracy and gets cranky when critics point out that it is not.” That it detains more journalists per capita than every other country except Eritrea, Mr. Martin went on, “is a powerful statement.”
Mr. Martin’s findings soon sparked a firestorm of controversy, with supporters of Israel crying foul at the latest instance of Israel-bashing in the prestige press. The outrage intensified once Jodi Rudoren, The New York Times’s newly appointed Jerusalem bureau chief, took to her Twitter account to weigh in. “What do Israel and Iran have in common? Jailing journalists, according to [CJR],” she wrote, without pausing to consider the soundness of such a claim. (She later apologized.)
The outrage was justified. Mr. Martin’s conclusion would not have passed professional muster under the standards CJR imposes on other outlets. Indeed, his methodology was a classic example of the sort of statistical recklessness that CJR scolds other journalists for.
To reach his per capita number, Mr. Martin merely divided the number of journalists detained—a number that, in the case of Israel, was debatable to begin with—by each country’s population in millions. As Commentary’s Omri Ceren pointed out, however, “If you want a ‘per capita’ number describing which countries disproportionately target journalists, you divide the jailed journalists in each country by the total number of journalists in each country, not by the total number of people.” Otherwise, tiny Israel—home to a huge press corps and where commentators in the Arab and leftist presses regularly question the state’s very right to exist—ends up appearing more repressive than, say, North Korea, where a totalitarian regime does not permit journalism as such to exist.
So Martin's argument goes like this: My statistics are meaningless, deceptive, and dangerous, but in my world, any statistics are better than none. I guess making up the news is OK as long as there isn't reliable news to report? I mean, something is always better than nothing. Right?
#1 Posted by Dave4321, CJR on Mon 16 Apr 2012 at 04:03 PM
Thank you Mr. Ahmari, for shining a light of reason on Justin D. Martin's flawed and juvenile foray into statistics,
Frankly, I'm shocked that a reputable publication like the Columbia Journalism Review would even have published such a ridiculous article.
I'm amused that Mr. Martin chose to defend his misuse of statistics with such passion and verbosity. It seems that not only does the Columbia Journalism program (undergraduate and graduate) have a severe deficiency in educating about statistics and their use, but they also lack basic instruction in critical reasoning.
One blogger has commented that Mr. Martin's assertion that "ratios of imprisoned reporters to countries’ population still deliver some meaning" is so silly, that it would be equally valid to compare the number of jailed journalists to the number of registered dogs in that country.
Where is the critical thinking that one would expect from an institution like Columbia University, and an organization like the Columbia Journalism Review? Why are they not providing some critique and thought in this ludicrous piece of pseudo-journalism and professional inadequacy by Mr. Martin?
#2 Posted by J-Practical, CJR on Mon 16 Apr 2012 at 05:26 PM
Well, I researched Monarch Programming in 2002 and didn't believe my own research, so advanced it all seemed, with hazy origins in the world of military mind control, rather than civilian concerns. Ignoring some obvious indicators that had I been fully aware could have caused a sensation....I was close to Mengele, so close he could take off a glove, laugh, chuckle and say clearly in heavily German accented English...(read my blog) as he poked me in the Adam's apple....while a minder tried to capture it on a DVD camera....just imagine had I made a citizen's arrest. But I didn't believe my research until last year. Mengele now shurely dead?
Was he in Mougins? I was a tall poppy but Mengele! Anyway, journalists can be subdued with less use of direct trauma. Read Will FIler + NSA = sneeze. And that, dear reader, is an example of an inspired researcher such as to get you noticed by Mengele and his minders. Let us hope they are sympathetic to CJR
#3 Posted by Tim Baber, CJR on Mon 16 Apr 2012 at 06:19 PM
i wonder whether journalists per capita is relevant where one journalist can write about everything. Thus, the number of journalists jailed is most relevant. Moreover, the measure doesn't discuss whether the journalists are jailed for reporting or for exposing secret information
#4 Posted by simon, CJR on Tue 17 Apr 2012 at 10:20 AM
The fact that Martin insists he did Israel "a favor" simply by reporting a single fact fairly and accurately speaks volumes about his personal attitude and journalistic rigor.
#5 Posted by Catherine, CJR on Tue 17 Apr 2012 at 12:23 PM
I have read Justin Martens article, the critique, and Mr. Martin's response.
Unfortunately Mr. Martin like most of us, is fiercely defensive of his creation (article) which I'm sure he wrote in good faith.
But he also wrote it in ignorance.
Using the standards of Katharine Graham (who I was closely associated with) he should have graciously admitted his flaws and withdrawn the article. Obviously, the right statistic is based on exposure which is not national per capita but operating reporters and journalists.
Again unfortunately this adds to the smear campaign against Israel. Mr. Martin should be aware that he is responsible for the expected consequences of his work product. And since his work product is deficient he should have had the journalistic integrity to withdraw his “findings”.
Thank you for bringing to our attention both the original article in the critique.
Mr. Martin please continue your efforts. However, do not commit the offenses that you attempt to guard against. Mr. Martin: take down your article and vow that you will do better in the future .ltch
#6 Posted by LT COL HOWARD, CJR on Tue 17 Apr 2012 at 04:14 PM
This guy is fixated on blaming Israel entirely for the current regional conflict, as his purported "journalism" amply demonstrates.
We can at least take his nonsense down... What of his poor students or the taxpayers on the hook for his salary?
#7 Posted by padikiller, CJR on Tue 17 Apr 2012 at 04:20 PM
There are liars, damn liars and statistics. Having studied statistics two years in grad school and courses in developing surveys, I became an agnostic because of the authoritarian implications of numerical absolutism which detract from the barest truths available at times, as it did in this "statistic" on journalists jailed in Israel by Mr. Martin. And it was gracious that he removed those journalists jailed by Hamas in Gaza from his calculations.
#8 Posted by Jerry Blaz, CJR on Wed 18 Apr 2012 at 04:13 AM