The fact checking industry is known to have a left-leaning bias, which manifests itself in both whose comments they decide to fact check, and their often absurd criteria for what's true or not.
I've been spending the past year writing on the many errors, lies, and distortions of the fact checking industry, and noticed a number of occasions where different fact checkers would fact check the same claim and come to different conclusions. As it turns out, there is a study out documenting the prevalence of this - and when the fact checkers do examine the same claim, they agree with themselves at a rate lower low enough to be deemed incompetent.
Back in 2017, Chloe Lim, then a PhD student at Stanford University obtained 1178 fact checks from Politifact, and 325 from the Washington Post's fact checker. Of those statements evaluated, there were 77 overlap statements from Politifact and Washington Post, indicating a different selection criteria for what both fact checkers decide to examine.
Of the 77 overlap statements, the fact checkers completely agreed on 49 of them, or roughly 64% of the time. Among the 28 cases where they disagreed, most of the disagreements were minor, the equivalent of one scale point (the difference between "true" and "mostly true," for example). But on six of them, or for roughly 8% of the overlapping statements, the fact checkers either mostly or entirely disagreed with one another. That the fact checkers are reaching a different conclusion nearly one out of ten times when they examine the same statement doesn't bode well for the reliability of the rest of their work. Even a 1% margin of error wouldn't be acceptable for organizations that now have become social media's de-facto arbiters of truth.
In one such example, Washington Post's fact checker gave Hillary Clinton's claim during a Democrat primary debate that she had never run a negative ad about Bernie Sanders "1 Pinocchio" (the equivalent of "Mostly True" on PolitiFact's scale), while Politifact rated Clinton's statement false.
We are starting to add back features from the original site. Please be patient with us.