PolitiFact inconsistent (again)

The fact checkers at PolitiFact exhibit a marvelous degree of inconsistency in their rulings.

Today's example comes from a fact check of GOP presidential contender Ben Carson.

Carson tried to address his lack of political experience by claiming none of the signers of the Declaration of Independence had previous political experience. The Washington Post Fact Checker tackled that claim and gave it four "Pinocchios."

PolitiFact was a little late in the game, and after the Johnny-come-latelys had started their fact check, Carson had amended the Facebook post that had drawn fact checkers' attention. It now read that none of the signers of the Declaration of Independence had federal elected office experience at the time.

PolitiFact went ahead with a two-pronged fact check, looking Carson's original claim and then evaluating the altered claim.

We find two types of inconsistency in this example.

First, if Carson is making the point that lack of political experience shouldn't overly concern voters, then it's particularly relevant which signers of the Declaration of Independence lacked political experience. PolitiFact focused purely on those who had political experience and ignored Carson's underlying point in the original claim.

Second, PolitiFact switched its focus to Carson's underlying argument for the altered version of his claim. It's beyond question that Carson is correct that none of the signers of the Declaration of Independence had experience in federal elective office. PolitiFact included quotations from experts affirming as much, like the following:

"It does not make sense to use the term ‘federal’ when no federal government existed," agreed Danielle Allen, a political theorist and author of Our Declaration: A Reading of the Declaration of Independence in Defense of Equality. "The signers of the declaration very often had leading political experience in their colony or, as they called them, in their ‘countries.’"

While it doesn't make sense as a support for Carson's underlying argument, the statement is at the same time undeniably true.

Consider what PolitiFact is doing, here. In one prong of its fact check it puts all its focus on the literal truth of Carson's statement and rates it "Pants on Fire." Yet if some of the signers of the Declaration of Independence lacked political experience Carson has some support for his underlying point. In the second prong of its fact check, PolitiFact sets aside the unequivocal truth of what Carson wrote and awards another "Pants on Fire" based entirely on the underlying argument.

Carson's argument from federal elected office experience is approximately as ridiculous as using the raw gender pay gap to argue for laws protecting against discrimination. Neither argument really makes sense. Yet PolitiFact won't rate that obviously flawed gender pay gap argument any lower than "Half True" since it's based on a legitimate statistic.

PolitiFact's inconsistent standards of judgment make pirates look principled by comparison.



Welcome aboard PolitiFact's Black Pearl, Dr. Carson.

PolitiFact Wisconsin: It's false until somebody fact-checks it

We've long registered our objections to PolitiFact's fallacious "burden of proof" criterion for political claims.

PolitiFact Wisconsin gives us a fantastic example of that flawed method with its fact check of Republican presidential candidate Ben Carson. Carson highlighted problems with advancement in the black community by saying there are more blacks involved with the criminal justice system than with higher education.

PolitiFact Wisconsin decided to evaluate claim and rated it "False." But of course there's a problem with the rating. PolitiFact Wisconsin found it had poor data with which to work:

(T)here is only one solid figure -- 75,000 black males ages 18 to 24 in prison. We’re not aware of any recent counts of the black males in that age group who were arrested, in jail, or on probation or parole at a particular time.

PolitiFact Wisconsin emphasized that relatively low solid figure in its summary paragraph:

Carson did not provide evidence that backs his claim. The latest federal figures we found show 75,000 black males in that age group who were in prison in 2013 and in the range of 690,000 to 779,000 who were in college. We are not aware of any recent figures for the number of black males ages 18 to 24 arrested, in jail, or on probation or parole at any particular time.

If figures do surface, we’ll re-evaluate this item, but we rate Carson’s claim False.

Perhaps it makes sense if the number of blacks ages 18 to 24 in college outnumber those involved with the criminal justice system 779,000 to 75,000. But that number comparison is rigged against Carson. PolitiFact Wisconsin acknowledges Carson's claim on unknown numbers of young blacks arrested, in jail, on probation or on parole.

And that's the Achilles' heel of PolitiFact Wisconsin's fact check. It collected enough information to enable rough estimates of those categories.

Was Carson's claim plausible?

We start our estimate by noting the percentage of blacks ages 18 to 24 in the federal prison population was fairly high: PolitiFact said the number of about 14 percent of the total black population.

We aim to create a conservative estimate, erring on the side of caution, so we'll assume that just 10 percent of blacks in the other categories fall in the 18 to 24 age range.

Arrests

PolitiFact Wisconsin noted that one individual might be arrested more than once. Still, the fact checkers gave the number 3 million for arrests of adult blacks in 2012. Ten percent of 3 million gives us a figure of 300,000, but to help account for multiple arrests we'll cut that number in half and use 150,000.

In Jail

PolitiFact Wisconsin gave a figure of 261,500 for jail inmates in mid-2013. Ten percent of that figure gives us about 26,000.

On Probation or Parole

PolitiFact Wisconsin said 4.75 million people of all races were on probation, parole or other supervision in 2013. The Bureau of Justice Statistics, PolitiFact's source, says blacks account for 30 percent of that number. That gives us 1.4 million, and 10 percent of 1.4 million comes to 140,000.

Totals

Combined with the 75,000 prison population PolitiFact Wisconsin used, our conservative estimate comes to 391,000--about half of PolitiFact Wisconsin's peak figure for black college enrollment. Based on our estimate, we think it's very unlikely Carson's claim exaggerates the truth by more than 100 percent, probably exaggerates it by substantially less than 100 percent and perhaps doesn't exaggerate at all.

For comparison, PolitiFact Georgia recently gave a "Mostly False" rating to a claim exaggerated by over 200 percent.

Do these numbers potentially support Carson's underlying point about the upward mobility of young black males? For some reason, PolitiFact Wisconsin did not deem that point worth considering.

Shall fact checkers rate claims "False" if they are difficult to settle? We think that's the wrong method. We also think fact checkers err by selectively ignoring politicians' underlying arguments. Either consider the underlying argument every time or never consider the underlying argument. Fairness demands it.