A woman I’ll call Gina, a 58-year-old hairdresser and Manhattan resident, is one of more than 587,000 New Yorkers who had completed applications for coverage in the New York insurance exchange as of last week, according to a press release from the state. But, like more than 250,000 of those people, she hadn’t yet enrolled in a plan—though not for lack of trying. On her most recent attempt to navigate the website she spent nearly three hours trying to compare policies, but found it impossible to make an apples-to-apples comparison for several plans she was considering. The details insurers offered were so skimpy, she gave up in disgust. “I might save $150 [compared to what she was paying under her existing policy] but I am not confident about what these plans are offering me,” she said. “They are not disclosing the real information you’d want to know. I am not going to take a leap of faith because the numbers look a little better, but not a lot better.” She put shopping on hold.
At this still-early stage in the Obamacare story, is Gina’s experience part of a “success” narrative because she completed an application and might even get cheaper coverage? Or is she part of a “signs of failure” storyline, because like 44 percent of signed-up New Yorkers, she hadn’t actually bought insurance on the exchange and she was frustrated by the process? Those questions bring up others: How do we capture the “big picture” of a story that will unfold for several years? What would Obamacare success look like, and what metrics should we use to measure it? And since it will likely still be years before we can render an informed judgment on the program’s efficacy at meeting its goals, and there are lots of incremental stories to write in the meantime, how do we cover those stories without passing on the agendas of one side or another in the Obamacare message war?
Press coverage from a recent New York State Senate hearing shows how many shades of Obamacare gray there are, and how advocates and politicians on both sides can seize on particular data points. The Associated Press article quoted Donna Frescatore, executive director of the state’s insurance exchange, calling the exchange launch an “overwhelming success”—and backing it up by noting the more than 300,000 New Yorkers who had bought a policy. But the same article also quoted Republican lawmakers noting only about 76,000 previously uninsured state residents had enrolled in a policy through the exchange, out of an uninsured population of 2.7 million. Of course, some of those uninsured folks are now presumably covered under New York’s federally-supported Medicaid expansion—and isn’t that a success, under the law’s provisions?
Covering the same hearing, Anemona Hartocollis of The New York Times led with a different measure: the share of young adults in the exchange pool, which some (though not all) observers see as key to a sustainable risk pool and stable premiums. Thirty percent of New York’s enrollees are under 35, Hartocollis reported, and Frescatore was “‘pleased with that as a very early indication’ that the exchange was working.” The ACA-boosting Times editorial board was pleased, too—but a critic might reply that even if insurance costs do stay under control in 2015, that’s not necessarily a sign that the law is on good footing for the long haul.
Will New York’s exchange be a success? The short answer is, it’s too soon to say. That sounds wishy-washy, but we can identify the right questions to ask, and start pressing them hard. Several years ago medical journalist Gary Schwitzer created a series of questions reporters should pose when writing about new medical interventions. John Lister, a professor of health policy at Coventry University in the UK, adapted Schwitzer’s framework for writing about health policy: Who’s claiming success (or failure) and are their conflicts of interest explored? What’s the evidence for the claims? What are the downsides, or in the case of numbers, what’s the context and the nuance?
That last one is especially important, as Washington Post factchecker Glenn Kessler showed in mid-January. An announcement by the pro-Obama group Organizing for America that 6 million people had signed up for coverage under the reform law depended on the claim—which had been widely reported—that 3.9 million people had been added to the Medicaid rolls. But as Kessler showed, that figure had essentially no meaning for coverage expansion—it “tells you almost nothing about how the Affordable Care Act is affecting Medicaid enrollment,” he wrote. In fact, “No one really knows” how many Americans are newly on Medicaid, at least not yet.