Showing posts with label Expert Bias. Show all posts
Showing posts with label Expert Bias. Show all posts

Thursday, December 12, 2019

William Barr, PolitiFact and the biased experts game

Is it okay for fact checkers to rely on biased experts for their findings?

Earlier this year, Facebook restricted distribution of a video by pro-life activist Lila Rose. Rose's group complained the fact check was biased. Facebook relied on the International Fact-Checking Network to investigate. The investigator ruled (very dubiously) that the fact check was accurate but that the fact checker should have disclosed the bias of experts it cited:
The failure to declare to their readers that two individuals who assisted Science Feedback, not in writing the fact-check but in reviewing the evidence, had positions within advocacy organizations, and the failure to clarify their role to readers, fell short of the standards required of IFCN signatories. This has been communicated to Science Feedback.
Perhaps it's fine for fact checkers to rely on biased experts so long as those experts do not hold positions in advocacy organizations.

Enter PolitiFact and its December 11, 2019 fact check of Attorney General William Barr.

The fact check itself hardly deals with the substance of Barr's claim that the "Crossfire Hurricane" investigation of possible collusion between the Trump campaign and Russia was started on the thinnest of evidence. Instead, PolitiFact sticks with calling the decision to investigate "justified" by the Inspector General's report while omitting the report's observation that the law sets a low threshold for starting an investigation (bold emphasis added).
Additionally, given the low threshold for predication in the AG Guidelines and the DIOG, we concluded that the FFG informat ion, provided by a government the United Stat es Intelligence Community (USIC) deems trustworthy, and describing a first-hand account from an FFG employee of a conversation with Papadopoulos, was sufficient to predicate the investigation. This information provided the FBI with an articulable factual basis that, if true, reasonably indicated activity constituting either a federal cri me or a threat to national security, or both, may have occur red or may be occurring. For similar reasons, as we detail in Chapter Three, we concluded that the quantum of information articulated by the FBI to open the individual investigations on Papadopoulos, Page, Flynn, and Manafort in August 2016 was sufficient to satisfy the low threshold established by the Department and the FBI.
The "low threshold" is consistent with Barr's description of "thinnest of suspicions" in the context of prosecutorial discretion and the nature of the event that supposedly justified the investigation (the Papadoupolous caper)*.

But in this post we will focus on the experts PolitiFact cited.

Rosa Brooks

Rosa Brooks, professor of law and policy at Georgetown University, told us that Barr’s assessment that the suspicions were thin "appears willfully inaccurate."

"The report concluded precisely the opposite," she said. "The IG report makes it clear that the decision to launch the investigation was justified."
If PolitiFact were brazen enough, it could pick out Brooks as a go-to (biased) expert based on her Twitter retweets from Dec. 10, 2019.



Brooks' tweets also portray her as a Democrat voter. So does her pattern of political giving.

Jennifer Daskal

Jennifer Daskal, professor of law at American University, agreed. "Barr’s statement is at best a misleading statement, if not a deliberate distortion, of what the report actually found," she said.
Daskal's Internet history shows little to suggest she pre-judged her view on Barr's statement. On the other hand, it seems pretty plain she prefers the presidential candidacy of Pete Buttgieg (one example among several). Plus Daskal has tended to donate politically to Democrats.

Robert Litt

PolitiFact contacted Litt for his expert opinion but did not mention him in the text of the fact check.

We deem it unlikely PolitiFact tabbed Litt to counterbalance the leftward lean of Brooks and Daskal. Litt was part of the Obama administration and his appointment carried an unusual political dimension to it. Litt failed his background check but was installed in the Clinton Justice Department in a roundabout way.

Litt, like Brooks and Daskal, gives politically to Democrats.


So what's the problem?

We think it's okay for PolitiFact to cite experts who lean left and donate politically to the Democratic Party. That's not the problem.

The problem is the echo-chamber effect PolitiFact achieves by choosing a small pool of experts all of whom lean markedly left. As we've noted before, that's no way to establish anything akin to an expert consensus. But it serves as an excellent method for excluding or marginalizing contrary arguments.

It's not like those are hard to find. It seems PolitiFact simply has no interest in them.



*It's worth noting that the information Papadoupoulos shared with the Australian, Downer, came in turn from the mysterious Joseph Mifsud.

Tuesday, April 7, 2015

But-but-but ... Experts!

I can imagine the PolitiFact apologist noticing that in our comparison between PolitiFact's alligator attack and shark attack stories that experts only complained about the silliness of the alligator attack comparison.

So, logically, it's not PolitiFact Florida's fault that the alligator attack comparison was silly while the shark attack comparison wasn't silly.

So there! Reality just has a liberal bias, and stuff.

Well, I covered this angle when I wrote up the alligator attack story at Zebra Fact Check.

Interpreting the comparison is not rightly the job of the criminology expert, nor the alligator attack expert. Those experts properly inform as to the number of attacks by concealed-carry permit holders, or the number of alligator attacks. It is the expert on English communications (if needed) that rightly evaluates the comparison. And in this case I challenge any expert on English to draw a principled distinction between PolitiFact Florida's stories on alligator and shark attacks. Both compare rare but dramatically different things. Both involve a number for which we don't have reliable statistics.

On the issue of experts pointing out the silliness of the comparison, the real question is why experts didn't call both comparisons silly.

Perhaps it was random variation.

Perhaps PolitiFact Florida didn't feel the need to interview a panel of experts about voter fraud.

Perhaps the experts carry their own political bias.

We think a fact checker should be able to make the call on a literary comparison that demands no particular English or logical expertise. And with respect to the alligator attack and shark attack stories, the call should be the same for both.

I'll reiterate what I wrote at Zebra Fact Check: Fact checkers should not allow experts to decide an issue outside their area of expertise.

Friday, September 14, 2012

Ben Shapiro: "Politifact Cites Three Liberal 'Apology Experts' to Condemn Romney"

Ben Shapiro, writing for Breitbart.com's Big Peace, pre-emptively steals my thunder on PolitiFact's ridiculous story on Mitt Romney and the statement from the American embassy in Libya.

Shapiro:

Just when you think Politifact can’t make any more of a mockery of itself than it already has – over and over and over and over again – they wade into the breach today on foreign policy. More specifically, they took issue with Mitt Romney’s statement today that “I think it’s a terrible course for America to stand in apology for our values.”
PolitiFact has a history of denying that things Mitt Romney says are apologies are, in fact, apologies.  Shapiro has fun with PolitiFact's method of undercutting Romney in this case:
So, what did Politifact have to say? They interviewed three “apology experts.” Seriously. First, they interviewed Professor John Murphy, of the University of Illinois at Urbana-Champaign, who said it wasn’t an apology because “the statement does not use the word ‘apology’ or ‘apologize’ and does not use any synonym for that word.” Second, they interviewed Lauren Bloom, “an attorney and business consultant who wrote The Art of the Apology.” What did she say? Romney’s “once again allowing his emotional allergy to apology to interfere with his judgment.” Finally, they interviewed Professor Rhoda E. Howard-Hassman, who said the statement was “not an apology.”
But is that PolitiFact's fault?  PolitiFact tried to contact a fourth expert who did not respond.  By looking at the earlier fact checks we can confirm that the expert was conservative foreign policy analyst Nile Gardiner of the Heritage Foundation.

What did Gardiner have to say in PolitiFact's original story?  Here it is:
Nile Gardiner, a foreign policy analyst with the the conservative Heritage Foundation, said Obama is definitely apologizing, and it's not good. He co-wrote the Heritage analysis, "Barack Obama's Top 10 Apologies: How the President Has Humiliated a Superpower."

"Apologizing for your own country projects an image of weakness before both allies and enemies," Gardiner said. "It sends a very clear signal that the U.S. is to blame for some major developments on the world stage. This can be used to the advanage of those who wish to undermine American global leadership."

He noted that Obama tends to be most apologetic about how the U.S. has fought terrorism and its approach to the Iraq war. "There is a very strong partisan element to his apologies, but the biggest driving factor is Obama's personal belief that the U.S. is not an exceptional, uniquely great nation," he said.
As I noted in an earlier analysis, PolitiFact completely discounted Gardiner's statement in ruling Romney "Pants on Fire" for saying Mr. Obama went on an apology tour.  PolitiFact did not explain its reasons for discounting Gardiner's expertise.  If partisanship was a problem then we should expect PolitiFact to find an entirely new set of experts.  Choosing the expert opinion of three liberals over one conservative looks simply like an expression of partisan bias by the fact checker when unaccompanied by a solid rationale.

In the latest apology for Obama, PolitiFact's three experts make a show of distinguishing between condemnation and apology.  But that approach obscures a potential relationship between condemnation and apology.

One cannot condemn an entity and apologize for that same entity at the same time with the same statement.  Those aims work against each other.  But very clearly, one can easily work a condemnation into an apology:  "My son was bad, bad, bad, bad, bad--a thousand times bad for breaking your window, Mrs. Jones."

In the above example we have an apology and a condemnation in the same sentence.  It works because the apology is directed at one entity (Mrs. Jones) while the condemnation is directed at a third party (the son).  By throwing a natural ally under the bus for breaking the window, the condemner sends a clear implicit message of regret to the offended party, Mrs. Smith.

It's important to emphasize the role of an apology in both personal and international relations:  An apology is an attempt to smooth things over with the offended party.  Condemning the breaking of the window sends a message to Mrs. Jones that something will be done to the window breaker to help balance the scales of justice.  Absent that implication, condemning the window-breaker isn't likely to sooth Mrs. Jones' ire.
 
In the case of the Libyan embassy, embassy officials clearly released the statement with the aim of defusing anger at the United States.  One can claim that it was a condemnation rather than an apology, but that's obfuscation.

It was a classic apology, delivered by implicit means.


***
Shapiro's sharp, pithy and to the point.  Visit Big Peace and read the whole of his take.