The discovery of a lively new critic of PolitiFact has inspired an overdue revision of the sidebar section featuring criticism of PolitiFact. The section wears a new name, "Contra PolitiFact" rather than "PolitiFact's Detractors." I removed broken links at Red State and the Washington Examiner.
The new critic writes anonymously at a brand-new blog called "counterirritant."
We look forward to highlighting criticisms of PolitiFact from this new source.
Monday, May 7, 2012
Sunday, May 6, 2012
Balancing act at PolitiFact Ohio?
Since its 2011 "Lie of the Year," the claim from Democrats that Republicans voted to end Medicare, PolitiFact has found itself trying to answer the criticism that it tries to achieve a false balance in its fact checking operations.
Past questions about the dangers of selection bias should have amply prepared PolitiFact editors to answer this sort of question.
Should have.
PolitiFact Ohio editor Robert Higgs of the Cleveland Plain Dealer took a shot at addressing the issue of balance in comments to the Plain Dealer's reader representative, Ted Diadium:
It won't result because selection bias will occur without active steps taken to avoid the problem.
Select nine stories likely to make Democrats look bad while selecting one that will likely made Republicans look good will not achieve balance regardless of applying identical standards in the evaluation--not that we at PolitiFact Bias believe PolitiFact applies its standards consistently.
Newsflash for Higgs: Every writer and editor at PolitiFact likely has a sense of how the stories break down by party. The "remarkably even" count that results at PolitiFact Ohio helps prove the point.
PolitiFact markets its stats as candidate report cards and the like, but the real value of PolitiFact's numbers comes from the insights we obtain into PolitiFact's behavior--not the behavior of those featured in the stories.
Correction: Changed the first of two consecutive instances of "the" to a "from" in the concluding paragraph. Hat tip to Jeff Dyberg for catching the the error.
Past questions about the dangers of selection bias should have amply prepared PolitiFact editors to answer this sort of question.
Should have.
PolitiFact Ohio editor Robert Higgs of the Cleveland Plain Dealer took a shot at addressing the issue of balance in comments to the Plain Dealer's reader representative, Ted Diadium:
I asked Bob Higgs, the editor who oversees the PolitiFact Ohio operation, if he deliberately tries for balance:Even if PolitiFact Ohio applies its evaluation standards consistently to all its stories, balanced treatment need not result. In fact, it probably won't result.
"The belief is that if we apply the same constructive standards to all claims, we'll end up treating all sides fairly," he said. "Some of the state operations (there are 10 in the PolitiFact organization), as well as the national operation, do not tally the rankings at all."
Higgs admits that he does tally up the results by party (which shows them remarkably even), "but only to see after the fact how we've done."
It won't result because selection bias will occur without active steps taken to avoid the problem.
Select nine stories likely to make Democrats look bad while selecting one that will likely made Republicans look good will not achieve balance regardless of applying identical standards in the evaluation--not that we at PolitiFact Bias believe PolitiFact applies its standards consistently.
Newsflash for Higgs: Every writer and editor at PolitiFact likely has a sense of how the stories break down by party. The "remarkably even" count that results at PolitiFact Ohio helps prove the point.
PolitiFact markets its stats as candidate report cards and the like, but the real value of PolitiFact's numbers comes from the insights we obtain into PolitiFact's behavior--not the behavior of those featured in the stories.
Correction: Changed the first of two consecutive instances of "the" to a "from" in the concluding paragraph. Hat tip to Jeff Dyberg for catching the the error.
Tuesday, May 1, 2012
NPR and truth-hustler guests Adair and Nyhan
Crossposted from Sublime Bloviations.
National Public Radio brought two of my favorite truth-hustlers on its "All Things Considered" program. I refer to Bill Adair and Brendan Nyhan.
Bill Adair serves as founding editor for Politico PolitiFact, a fact-checking operation started by a left-leaning Florida newspaper. PolitiFact sacrifices journalistic objectivity in part for the sake of its marketing gimmick, called the "Truth-O-Meter."
Political scientist Brendan Nyhan mangles facts from the realm of academia. Nyhan has tried to show that partisans don't accept facts that contradict their ideology. His research often uses facts that beg the question (more on Nyhan), suggesting that Nyhan falls victim to his own research goal.
The relevant radio program segment deals with a column from Chicago Tribune columnist Rex Huppke, who bemoaned the state of truth following Rep. Allen West's statement, using Huppke's paraphrase, that "as many as 81" members of the Democratic Party are members of the Communist Party.
Huppke gets some kind of award for irony. Journalists took West out of context. West was jokingly, though to make a seriously point, referring to the Congressional Progressive Caucus. The context makes that absolutely clear.
Stories like these are to Adair and Nyhan what the Trayvon Martin case is to Jesse Jackson and Rev. Al Sharpton. The media want the narrative that the former two spin and so seek them out for commentary when these issues make the news. Adair and Nyhan are the truth-hustler counterparts to race-hustlers.
Adair shows up to remind us how great it is thatPolitico PolitiFact is there to save the day, if only we can place sufficient trust in its work.
Adair (transcript mine, from the NPR audio):
PolitiFact's system is perfect for filtering the truth according to media ideology.
Academia, unfortunately, carries an ideological slant somewhat akin to that found in the U.S. media. Nyhan perhaps represents one of academic liberalism's top leaders in the war over political truth.
NPR brought forth an old example of Nyhan's supposed "backfire" effect, where a correction of a falsehood leads to stronger belief in the falsehood. Though Nyhan's own research (see descriptions of "Study 2") appears to show that the phenomenon does not occur with clear corrections, that hardly dampens mainstream media enthusiasm for the idea. They can claim they're doing a great job but the audience is the problem.
There is something of an information crisis, but Adair and Nyhan probably do as much damage as good in addressing the problem. We're not getting the best information from either journalists or academia. Journalists typically do not have the expertise to sift through complex issues of truth. Academics have shifted left ideologically and do an inadequate job of critically reviewing the journals that ought to provide our best sources of trustworthy information.
We don't have a reliable gatekeeper for our pool of information. And it's hard to come up with good solutions to the problem.
National Public Radio brought two of my favorite truth-hustlers on its "All Things Considered" program. I refer to Bill Adair and Brendan Nyhan.
| (clipped from npr.org 4/29/12) |
Political scientist Brendan Nyhan mangles facts from the realm of academia. Nyhan has tried to show that partisans don't accept facts that contradict their ideology. His research often uses facts that beg the question (more on Nyhan), suggesting that Nyhan falls victim to his own research goal.
The relevant radio program segment deals with a column from Chicago Tribune columnist Rex Huppke, who bemoaned the state of truth following Rep. Allen West's statement, using Huppke's paraphrase, that "as many as 81" members of the Democratic Party are members of the Communist Party.
Huppke gets some kind of award for irony. Journalists took West out of context. West was jokingly, though to make a seriously point, referring to the Congressional Progressive Caucus. The context makes that absolutely clear.
Stories like these are to Adair and Nyhan what the Trayvon Martin case is to Jesse Jackson and Rev. Al Sharpton. The media want the narrative that the former two spin and so seek them out for commentary when these issues make the news. Adair and Nyhan are the truth-hustler counterparts to race-hustlers.
Adair shows up to remind us how great it is that
Adair (transcript mine, from the NPR audio):
"What's funny is sometimes I'll get an email that'll say 'You guys are so biased.' But I won't know who we're supposed to be biased in favor of, because we get criticized a lot by both sides. And I think that's just the nature of a very rough-and-tumble political discourse."Funny is Adair still using the "we get criticized from both sides" dodge to avoid the issue of bias. Fortunately a journalist asked Adair exactly the right question earlier this year with equally hilarious results.
PolitiFact's system is perfect for filtering the truth according to media ideology.
Academia, unfortunately, carries an ideological slant somewhat akin to that found in the U.S. media. Nyhan perhaps represents one of academic liberalism's top leaders in the war over political truth.
NPR brought forth an old example of Nyhan's supposed "backfire" effect, where a correction of a falsehood leads to stronger belief in the falsehood. Though Nyhan's own research (see descriptions of "Study 2") appears to show that the phenomenon does not occur with clear corrections, that hardly dampens mainstream media enthusiasm for the idea. They can claim they're doing a great job but the audience is the problem.
There is something of an information crisis, but Adair and Nyhan probably do as much damage as good in addressing the problem. We're not getting the best information from either journalists or academia. Journalists typically do not have the expertise to sift through complex issues of truth. Academics have shifted left ideologically and do an inadequate job of critically reviewing the journals that ought to provide our best sources of trustworthy information.
We don't have a reliable gatekeeper for our pool of information. And it's hard to come up with good solutions to the problem.
Test everything. Hold on to the good.
--Paul the Apostle, 1 Thess. 5:21
Thursday, April 26, 2012
Nothing To See Here: Joe Biden's bizarre warning
Vice-president Joe Biden is concerned about Mitt Romney's foreign policy views, which he thinks are out of step with the mainstream.
Biden:
Biden:
"Americans know that we cannot afford to go back to the future."It definitely looks like a job for charitable interpretation plus corresponding poll data.
Nothing To See Here: Obama quotes a Republican congresswoman?
A very recent presidential speech, via Whitehouse.gov:
(hat tip to the Washington Post)
THE PRESIDENT: (...)We trust you?
One Republican congresswoman said just recently -- I’m going to quote this because I know you guys will think I’m making it up -- (laughter).
AUDIENCE MEMBER: We trust you. (Laughter.)
THE PRESIDENT: No, no, no. She said she had "very little tolerance for people who tell me they graduate with debt because there’s no reason for that."
(hat tip to the Washington Post)
Anchor Rising: "Abortion Question Shows PolitiFact RI's Bias and Ignorance"
Blogger Justin Katz of Rhode Island's "Anchor Rising" recently hit PolitiFact for its poor handling of the abortion issue in a fact check of Jon O'Brien. O'Brien serves as president of the self-explanatory group Catholics for Choice.
Katz makes great points about the ignorance of Roman Catholic doctrine displayed in the fact check.
Katz:
Katz covers it all and then some, so pay a visit and read it through.
It's worth adding that many Catholics out of agreement with Vatican teaching on abortion think they agree with Vatican teaching on abortion. Using such statistics often matches a fallacious pattern of argument.
Katz makes great points about the ignorance of Roman Catholic doctrine displayed in the fact check.
Katz:
(I)n order that I may exorcise today's demon, I have to point out the ignorance and bias on display in Eugene Emery's finding that it is "mostly true" that "only 14 percent of Catholics agree with the Vatican's position that abortion should be illegal."Katz goes on to show that PolitiFact's fact-finding fudges on all three points. PolitiFact failed to look into the crucial term "direct abortion" in the portion of the catechism it quoted and made no effort to correlate the actual Catholic doctrines to the poll data.
An objective assessment must acknowledge that there are two parts to the question, with a third qualifier necessary for an understanding of the results:
- What is the Church's position on the matter?
- Do Catholics agree with that position?
- In what sense are the respondents "Catholic"?
Katz covers it all and then some, so pay a visit and read it through.
It's worth adding that many Catholics out of agreement with Vatican teaching on abortion think they agree with Vatican teaching on abortion. Using such statistics often matches a fallacious pattern of argument.
Tuesday, April 24, 2012
Hot Air: "PolitiFact Goes to the Dogs"
This week PolitiFact flexed their Pulitzer-sized muscle by...copying and pasting.
Our fact-finding friends decided the hubbub surrounding our commander-in-chief's canine cuisine wasn't worthy of a fact check, but wanted to weigh in on it anyway. What better way to put the issue "In Context" than to simply reprint the passage from Obama's book? Karl over at Hot Air was quick toSpot spot the ruse:
After receiving several criticisms on Twitter about being unable to determine what is a widely acknowledged fact, PolitiFact attempted to reframe the article as simply putting the issue "In Context":
That defense falls flat. Check out how PolitiFact (originally) headlined the article:
Did Obama eat dog in Indonesia? The question mark implies doubt. The only thing missing here is PolitiFact's gimmicky Truth-O-Meter graphic. The offending headline has since been scrubbed from the website and replaced with the more benign heading: "In context: Obama's comments on eating dog in Indonesia." Of course, no editor's note or mention of the change is provided. (The question in question is still up on PolitiFact's Facebook page, but links to a version of the story with the updated headline).
John Sexton over at Breitbart describes the trouble with the transmuted title:
Awww...
The bottom line is PolitiFact failed to provide any context that wasn't already widely available. The one angle of the story they could have clarified was whether or not eating dog meat was customary (or even common practice) in Indonesia at the time of the incident. But if you thought that kind of context would be provided by the Pulitzer-winning outfit in a feature they call "In Context", you'd be wrong. Instead, we're forced to rely on the word of those biased extremists over at Breitbart to do the legwork PolitiFacter Louis Jacobson was too busy to do:
Our fact-finding friends decided the hubbub surrounding our commander-in-chief's canine cuisine wasn't worthy of a fact check, but wanted to weigh in on it anyway. What better way to put the issue "In Context" than to simply reprint the passage from Obama's book? Karl over at Hot Air was quick to
Although the heart of PolitiFact is the Truth-O-Meter, which they use to rate factual claims. [sic] author Louis Jacobson assigned no rating to the seemingly straightforward question of whether Obama ate dog.Karl's post is well worth the read, but I think his buddy Ace summed it up nicely on Twitter:
![]() |
| Image from Twitter |
![]() |
| Image from Twitter |
That defense falls flat. Check out how PolitiFact (originally) headlined the article:
![]() |
| (Image from PolitiFact's Facebook page) |
Did Obama eat dog in Indonesia? The question mark implies doubt. The only thing missing here is PolitiFact's gimmicky Truth-O-Meter graphic. The offending headline has since been scrubbed from the website and replaced with the more benign heading: "In context: Obama's comments on eating dog in Indonesia." Of course, no editor's note or mention of the change is provided. (The question in question is still up on PolitiFact's Facebook page, but links to a version of the story with the updated headline).
John Sexton over at Breitbart describes the trouble with the transmuted title:
Ace of Spades began questioning what exactly Politifact was suggesting with their headline shortly after the story appeared. Is there some doubt about the dog-eating story? If so, why not offer a ruling? And if there's actually no doubt, why write a factcheck piece at all? What does "context" actually add in this case? Either Obama ate dog or he didn't.But headline hijinks aren't the only problems with this article. Karl goes on to point out that PolitiFact has not shied away from animal related claims in the past:
Friday afternoon, Politifact rewrote their headline. As you can see, it now reads "In context: Obama's comments on eating dog in Indonesia." No more question mark, which is presumably their way of saying the story is true. And yet, we still get no "true" ruling. And there is still no explanation of what the context adds to this discussion.
More significantly, PolitiFact’s responses ignore their much more relevant track record in this particular area. For example, PolitiFact rated the story about the Romneys transporting the family dog on the roof of their car as “Mostly True.” And PolitiFact rated the story about former Arkansas Gov. Mike Huckabee frying squirrels in a popcorn popper simply “True.”In all fairness to PolitiFact, they have indeed rated Obama on a dog claim:
![]() |
| (Image from PolitiFact.com) |
Awww...
The bottom line is PolitiFact failed to provide any context that wasn't already widely available. The one angle of the story they could have clarified was whether or not eating dog meat was customary (or even common practice) in Indonesia at the time of the incident. But if you thought that kind of context would be provided by the Pulitzer-winning outfit in a feature they call "In Context", you'd be wrong. Instead, we're forced to rely on the word of those biased extremists over at Breitbart to do the legwork PolitiFacter Louis Jacobson was too busy to do:
A diplomatic source close to the Indonesian delegation in the U.S. confirms that while dog is sometimes eaten in Indonesia, it is done so very rarely. “Obama had to go hunting for dog meat,” the source, who didn’t want to be identified, told me.PolitiFact's latest "In Context" article was little more than a device for them to delicately acknowledge a popular and controversial issue without actually having to take a position on it. People who claim to be objective servants of fact should be unconcerned with perception. But PolitiFact are not those people. They didn't sort out the truth of anything or even put anything in context. They punted. Their Obama eats dog article was an evasion. Readers should expect more of the same in the coming months.
“I don’t know of anyone who eats it and frankly, I’m a little offended you would ask.”
Breitbart.com scoured Indonesian cook books. Not one mentions ways to prepare dog.
Friday, April 20, 2012
Nothing To See Here: Republicans for violence against women?
Stephanie Schriock from Emily's list sent me an email today:
I wonder if Schriock is telling the entire story ...
Frankly, I'm disgusted that I even have to write this message. You would think that if any issue was safe from political posturing, it would be violence against women.Can you believe those Republicans, engaging in political posturing on an issue like violence against women?
But no. Next week, the Senate is scheduled to vote on renewing the Violence Against Women Act, and Republicans can't stop playing politics for a single day on an issue this important. Many, many Republicans in Congress have announced their opposition to renewing the Act -- including some of those running against our women.
I wonder if Schriock is telling the entire story ...
Subscribe to:
Posts (Atom)



