What if we lived in a world where PolitiFact applied to itself the standards it applies to others?

In that impossible world where PolitiFact applied its own standards to itself, PolitiFact would doubtless crack down on PolitiFact's misleading headlines, like the following headline over a story by Lauren Carroll:

While the PolitiFact headline claims that the Trump budget cuts Medicaid, and the opening paragraph says Trump's budget "directly contradicts" President Trump's promise not to cut Medicaid, in short order Carroll's story reveals that the Medicaid budget goes up under the new Trump budget.

So it's a cut when the Medicaid budget goes up?

Such reasoning has precedent at PolitiFact. We noted in December 2016 that veteran PolitiFact fact-checker Louis Jacobson wrote that the most natural way to interpret "budget cut" was against the baseline of expected spending, not against the previous year's spending.

Jacobson's approach in December 2016 helped President Obama end up with a "Compromise" rating on his aim to cut $1 trillion to $1.5 trillion in spending. By PolitiFact's reckoning, the president cut $427 billion from the budget. PolitiFact obtained that figure by subtracting actual outlays from the estimates the Congressional Budget Office published in 2012 and using the cumulative total for the four years.

Jacobson took a different tack back in 2014 when he faulted a Republican ad attacking the Affordable Care Act's adjustments to Medicare spending (which we noted in the earlier linked article):

First, while the ad implies that the law is slicing Medicare benefits, these are not cuts to current services. Rather, as Medicare spending continues to rise over the next 10 years, it will do so at a slower pace would [sic] have occurred without the law. So claims that Obama would "cut" Medicare need more explanation to be fully accurate.

We can easily rework Jacobson's paragraph to address Carroll's story:

First, while the headline implies that the proposed budget is slicing Medicaid benefits, these are not cuts to current services. Rather, as Medicaid spending continues to rise over the next 10 years, it will do so at a slower pace than would occur without the law. So claims that Trump would "cut" Medicaid need more explanation to be fully accurate.

PolitiFact is immune to the standard it applies to others.

We also note that a pledge not to cut a program's spending is not reasonably taken as a pledge not to slow the growth of spending for that program. Yet that unreasonable interpretation is the foundation of PolitiFact's "Trump-O-Meter" article.


Correction May 24, 2017: Changed the first incidence of "law" in our reworking of Jacobson's sentence to "proposed budget." It better fits the facts that way.
Update May 26, 2017: Added link to the PolitiFact story by Lauren Carroll

PolitiFact looking VOXier every day! (Updated)

Remember how Ezra Klein took his Washington Post Wonkblog act independent, starting the fact-challenged left-wing 'splainer site VOX?

PolitiFact is taking pages from the VOX playbook.

PolitiFact has always had VOX's ability to get things remarkably wrong, so the latest new sign of Voxiness comes from PolitiFact stories that venture into 'splaining instead of fact-checking. The item that especially caught our eye was one saying Republican presidential candidate Donald Trump is incorrect for saying the United States should have taken Iraq's oil.

Trump's suggested policy on Iraq's oil is a choice with a moral, right/wrong dimension. As such PolitiFact's condemnation of the proposal amounts to moralizing. And isn't that exactly what we want from fact checkers?

We suspect the real reason PolitiFact is delving into overt PolitiSplaining has to do with its desire to share parts of expert interviews like this one:

"Insofar as Mr. Trump's proposals are coherent enough to be subject to analysis and judgment, they appear to be practically impossible, legally prohibited, and politically imbecilic," said Barnett Rubin, associate director of New York University’s Center on International Cooperation.

PolitiFact didn't say that about Trump! It was the expert! The expert did it! Was PolitiFact supposed to not print such a memorable quotation?

At PolitiFact Bias, we have long charged that PolitiFact's fact-checking routinely crosses the line from objective reporting into the realm of opinion journalism. An interview posted recently at Poynter.org, which owns PolitiFact through the Tampa Bay Times, underscores the accuracy of our assessment. Brad Scribner interviewed Lucas Graves, a recognized expert on fact-checking who did intern stints at PolitiFact and FactCheck.org. Scribner asked Graves about the relationship between fact-checking and the traditional "opinion page" in newspapers.

Graves:

It’s actually a misnomer to call the opinion page the opinion page. Really it’s the argument page. People are laying out fact-based arguments. We often confuse that sense of opinion with opinion as taste — where there’s no objective way to say which flavor of ice cream is better, but that’s not true of the kinds of points being made on the opinion page. They do involve facts — facts arrayed into arguments — and those arguments require interpretation. But any important or interesting factual question usually requires interpretation.

PolitiFact founder Bill Adair once called fact checking "reported conclusion journalism" and that’s a really good description.

 Find the whole interview at Poynter's website.


Update/Afters Sept. 12, 2016

We quoted PolitiFact's gem of a quotation from expert Barnett Rubin in our post above. It was quite uncomplimentary to Trump, so much so that we felt it reasonable to question Rubin's neutrality on that basis alone.

In our opinion, PolitiFact did Rubin no favors by quoting him.

We looked up Rubin's record on the FEC database. No surprise: He donates to Democrats.

Is it fine that PolitiFact does not inform its readers about stuff like this?

We wouldn't have that big a problem with it if it didn't represent such a marked pattern.


Correction Sept. 13, 2016: Our final mention of Barnett Rubin misspelled his last name as "Rubion." We apologize for the error, which is now corrected. Same day additional correction: The problem was worse than we noticed: We called Barnett Rubin "Barret" Rubin. We treble our apology.

The circus inside PolitiFact's "Star Chamber"

I suspect that many people think, as I originally did, that PolitiFact selects its "Truth-O-Meter" ratings through something like an objective process.

Andrew Phelps of the Nieman Journalism Lab recently sat in on PolitiFact's formerly private deliberations and produces much the picture I have come to expect (pun not intended) during my years of increasing skepticism.

Adair doesn't reveal his politics.  Who put that Obama cutout back there?

Phelps:

WASHINGTON — PolitiFact’s “Star Chamber” is like Air Force One: It’s not an actual room, just the name of wherever Bill Adair happens to be sitting when it’s time to break out the Truth-O-Meter and pass judgment on the words of politicians. Today it’s his office.

Three judges preside, usually the same three: Adair, Washington bureau chief of the Tampa Bay (née St. Petersburg) Times; Angie Drobnic Holan, his deputy; and Amy Hollyfield, his boss.

"Star Chamber" aptly describes the secretive nature of the judges' meeting. PolitiFact staffers sometimes talk about what goes on in the meetings, but PolitiFact readers get no "report card" on the voting records of the fact check judges.

Jeff and I have repeatedly criticized PolitiFact's process for its institutionalization of PolitiFact's group ideology. Phelps' descriptions and transcripts bring our worst nightmares to life as the judges make their decisions with no apparent grounding in objective data. Phelps featured the following transcript early in his story:

Hollyfield: Is there any movement for a Pants on Fire?

Adair: I thought about it, but I didn’t feel like it was far enough off to be a Pants on Fire. What did you think, Lou?

Jacobson: I would agree. Basically it was a case I think of his staff blindly taking basically what was in Drudge and Daily Caller. Should they have been more diligent about checking the fine print of the poll? Yes, they should have. Were they being really reckless in what they did? No. It was pretty garden-variety sloppiness, I would say. I don’t think it rises to the level of flagrancy that I would think of a Pants on Fire.

Adair: It’s just not quite ridiculous. It’s definitely false, but I don’t think it’s ridiculous.

1. Hollyfield tests for support of the "Pants on Fire" rating she apparently wishes to promote.
2. Adair didn't "feel" the claim went that far. How far is too far?
3. Writer Jacobson (not one of the judges) also offers his vote in terms of opinion: He doesn't "think" it's flagrantly false. What's the objective measure for "flagrant"?

Perhaps editor Angie Drobnic Holan, whose opinion was missing from this exchange, carried the torch for objective standards during the meeting. But don't bet on it. The portion of the conversation Phelps provides smacks of exactly the type of subjectivity hypothesized in PolitiFact Bias' initial research study into PolitiFact's bias.

Phelps:

Like the original Court of Star Chamber, PolitiFact’s Truth-O-Meter rulings have always been secret. The Star Chamber was a symbol of Tudor power, a 15th-century invention of Henry VII to try people he didn’t much care for.

...The site’s basic idea — rate the veracity of political statements on a six-point scale — has modernized and mainstreamed the old art of fact-checking.

Granted, I put together statements from Phelps a few sentences apart, but regardless of that one is still struck by the segue from PolitiFact's parallel to the 15th century "Star Chamber" to the praising of PolitiFact for modernizing fact checking. Indeed, the abandonment of transparency occurs as one of PolitiFact's most distinctive innovations in the fact checking business.

The secret voting serves the same purpose as the secrecy about staff members' voting history. PolitiFact does not want its readers taking the fact checkers' biases into account. The fact checkers doubtless assure themselves of their neutrality as nearby two-dimensional cardboard Obamas smile approvingly at their work.

Phelps:

The truth is that fact-checking, and fact checkers, are kinda boring. What I witnessed was fair and fastidious; methodical, not mercurial. (That includes the other three (uneventful) rulings I watched.) I could uncover no evidence of PolitiFact’s evil scheme to slander either Republicans or Democrats. Adair says he’s a registered independent. He won’t tell me which candidate he voted for last election, and he protects his staff members’ privacy in the voting booth. In Virginia, where he lives, Adair abstains from open primary elections. Revealing his own politics would “suggest a bias that I don’t think is there,” Adair says.

It's nice that Phelps didn't see any obvious bias, but who is he kidding? The PolitiFact staff knew he was observing them, didn't they? I think probably PolitiFact doesn't deliberately slant its fact checks, but Phelps offers the thinnest of reassurances on that count, particularly since the tone of his story suggests he shares the port side slant so common in modern journalism.

We could probably mine Phelps' story for a week's worth of material.  Maybe we will.

All credit to Jeff for spotting the President Obama cardboard figure in Adair's office that turns the statement about staffers' voting history into an absolute howler.

But don't get the idea that Adair is biased or anything. We wouldn't want that.


Jeff adds:

This ode to the majesty of PolitiFact's Echo Star Chamber is jaw-droppingly awful. Phelps' inability to untangle the contradictions in front of his own eyes was painful to read. For example, he describes the Truth-O-Meter as "simple, fixed, unambiguous." Unfortunately, Phelps never reconciles these concrete terms with the subjective nomenclature of the actual ratings. He writes:

“Pants on Fire,” a PolitiFact trademark reserved for claims it considers not only false but absurd.

Phelps never shares PolitiFact's unequivocal, dispassionate standard for "absurd." And the ratings process Phelps describes as "fair and fastidious; methodical", ultimately boils down to "What did you think, Lou?"

But fear not PolitiFans. PolitiPhelps assures us that he "could uncover no evidence of PolitiFact’s evil scheme to slander either Republicans or Democrats." This is the same Andrew Phelps who once asked "[W]hy is George Bush such a flaming moron?" The man who described Maureen Dowd as "The person who best captures my feelings about our miraculously awful [Bush] administration" is confident Bill Adair gives it to us straight.

It's worth noting that Phelps, despite mentioning the left's outrage over the recent LOTY rating, as well as Rachel Maddow's outbursts, was unable to link to the any of the persistent, and numerous PolitiFact rebukes from the right. It's been our experience that PolitiFact's attacks from the left are very often lame, but they get the links in Phelps' piece.

If there are actual scientific, objective standards applied to PolitiFact's ratings, Phelps failed to report them. Phelps' flattering prose aside, the article shows that PolitiFact's system is really just a bunch of coworkers asking each other if they are having a "movement."