Jose L. Duarte
  • Home
  • Blog
  • Media Tips
  • Research
  • Data
  • An example
  • Haiku
  • About

Lewandowsky scam

7/29/2014

3 Comments

 
What a summer. I've also called for the retraction of the following paper:

Lewandowsky, S., Oberauer, K., & Gignac, G. E. (2013). NASA faked the moon landing—therefore, (climate) science is a hoax: an anatomy of the motivated rejection of science. Psychological Science, 24(5), 622–633.

The title draws a link between belief in the moon landing hoax and belief that climate science is also a hoax. The title is false. The relationship between those variables is the opposite of that reported. Worse is how the title even suggests a causal relationship here, that climate science hoaxists (which will likely be encoded as skeptics to many readers) got there by starting with the moon hoax belief.

Dr. Lewandowsky has already admitted that there is no link, on his blog here:

"Let's consider the signal vs. noise issue first. We use the item in our title, viz. that NASA faked the moon landing, for illustration. Several commentators have argued that the title was misleading because if one only considers level X of climate "skepticism" and level Y of moon endorsement, then there were none or only very few data points in that cell in the Excel spreadsheet.
Perhaps. But that is drilling into the noise and ignoring the signal. The signal turns out to be there and it is quite unambiguous: computing a Pearson correlation across all data points between the moon-landing item and HIV denial reveals a correlation of -.25. Likewise, for lung cancer, the correlation is -.23. Both are highly significant at p < .0000...0001 (the exact value is 10 -16, which is another way of saying that the probability of those correlations arising by chance is infinitesimally small).
What about climate? The correlation between the Moon item and the "CauseCO2" item is smaller, around -.12, but also highly significant, p < .0001. Now you know why the title of our paper was “NASA faked the moon landing—Therefore (Climate) Science is a Hoax: An Anatomy of the Motivated Rejection of Science.” We put the "(climate)" in parentheses before "science" because the association between conspiracist ideation and rejection of science was greater for the other sciences than for climate science."

That's his explanation for the title? It's the most incredible example of tortured reasoning I've ever seen. I doubt I'll ever see anything like this again. He says he put climate in the title because it was the smallest effect, outweighed by others? The fact that there are parentheses around it is supposed to alert readers that it is the lesser effect, and readers will know that two unmentioned variables – HIV and lung cancer conspiracies – were more significant, because we all know that parentheses means "the enclosed effect is smaller than the effects for HIV and lung cancer research" in modern English. One wonders why, given all this concern for "signals" and noise, the parentheses in the headline didn't say something about HIV or smoking/lung cancer, since those were the effects, not climate hoaxism. 

It gets much worse. There was never any effect. The CauseCO2 item he cites is not the climate hoax variable – it's just one random item out of six items to do with climate, and the correlation is a scam, as we will see below. I was curious why Lewandowsky never mentions the actual climate hoax variable, CYClimateChange, since his title explicitly references climate hoaxism, and CYClimateChange is the item – the only item – that asks participants if they believe climate science is a hoax. So I looked in the dataset (available here). Of 1145 participants, 3 agree with – at any level – both the moon hoax and the climate hoax. To repeat, 3 out of 1145 participants fit the smear in the headline. The items are based on a 1 to 4 scale of disagreement/agreement, from strongly disagree to strongly agree. My count of three qualifying participants includes anyone who gave a 3 or 4 on the moon hoax and a 3 or 4 on the climate hoax. There is no effect driven by mutual endorsement of these hoaxes. The phenomenon stressed in the headline is simply not in this data.

Note that in the entire dataset, only 10 participants agree with the moon hoax at any level (3 or 4), a profile that is of course central to the effect claimed in the headline.

134 of the participants, 11.7% of the sample, agree with the climate hoax idea, on any level. Of those, 131 disagree with the moon hoax, and 122 of those strongly disagree with it (a 1 on the scale). That is, 97.8% of those who agree with the climate hoax idea disagree with the moon hoax, in staggering contradiction of the headline that was snapped up by the media all over the world.

The truth is the exact opposite of the headline. If someone believes that climate science is a hoax, there are extremely likely to reject the idea that the moon landing was a hoax. And of the ten people who believed in the moon hoax, most did not endorse a climate hoax (7 out of 10 rejected it).

Also note that the skew of this data undermines our ability to obtain any meaningful correlations from it. We will not be able to generate valid correlations when only 10 out of 1145 participants endorsed the hoax, only made worse by the fact that the response scale ranges from 1 to 4. Anyone who would report Pearson correlations in that circumstance, on that variable, and tout their "significance", demonstrates a profound incompetence with elementary statistics and/or or fraudulent intentions. His bluster about the "signal and the noise" was complete nonsense, presumably meant to convey the cues of statistical competence and scientific authority, and would make no sense to any qualified practitioner of quantitative psychology, given the characteristics of this data. And regarding that CauseCO2 item he cited, there are only 4 participants who both disagreed that CO2 causes warming and agreed with the moon hoax idea. 97.5% of those who disagreed with the CauseCO2 item, also disagreed with the moon hoax idea. His correlation there was a scam, a type of artifact of linear correlation that I'll go into another time. This requires logistic regression after you've removed all the outlier or high leverage items. 

I offer this definition of fraud: knowingly making a claim that your data do not support, where your (authentic) data do in fact test the claim (i.e. the answer is in your data, whatever the answer is). Fraud can be granular, at the level of Excel spreadsheets and invented statistics, or at the headline level. This is fraud, at the headline level. The headline is false, declaring the exact opposite of the truth. It reverses the relationship given by the data (and the data here will not survive a light breeze, much less things like Cook's distance).

This was an unbelievably awful thing to do, the worst case of malpractice I've seen. It established a link, in the minds of biased journalists and perhaps millions of news consumers, between this moon hoax nonsense and climate skepticism. The apparent malice and pettiness behind such malpractice is deeply disturbing, that anyone would want to do that to millions to people, to marginalize them in public life, by falsely linking them to one of the most insane hoax conspiracies out there (NASA actually landed men on the moon six times – trivia tidbit.)

Something is going on here. Lewandowsky is associated with that deceptively named "SkepticalScience" crew who pushed out the junk 97% study. This is very disturbing. You've got people running a junk study to try to inflate the consensus with the most invalid method we could think up, while their friends in social science are publishing fraudulent studies that smear people who doubt that same (inflated) consensus. Elegant. This is garbage, and we may need a dump truck to clean up social science. I'm looking foward to Chris Mooney's correction/retraction on the Lewandowsky paper, and his future curiosity about actual science.

In the long arc of our civilization, I think the credibility of scientists and journals will likely matter more in influencing public action than whether we can cite "97%" vs. say 91%. The perverse injection of simplistic partisan politics into science needs to come to a speedy end. Journals and scientific bodies, like the politicized AAAS, are doing enormous damage, if we're looking past next week.


3 Comments
Barry Woods
8/6/2014 12:26:28 am

Professor Lewandowsky wrote another paper in PLOSone journal with a similar survey, this time run by an American survey company, which surveyed the general public in the USA.


He claims this replicated LOG12's results, however a look at the data (processed not raw), showed similar problems and that the general public also believed in conspiracies in tiny numbers... whoever they were

Just for fun though, 50 people subscribed to the moon hoax CYmoon in the PLOSOne paper vs 10 (scammed?) results in the moon hoax paper. Thus if we were to go down the rabbit hole we 'could' say that the general public were 5 times MORE likely to believe in that conspiracy than climate bloggers...

Lewandowsky, he mentions at Shaping Tomorrows world (his blog) that his PLOS One paper, survey of USA public, claimed to replicate Moon Hoax; ref free market and delineation here:

http://shapingtomorrowsworld.org/rf1.html

"Some 18 months ago I published a paper with colleagues Oberauer and Gignac that reported a survey of visitors to climate blogs which established a small, but significant, association between the endorsement of conspiracy theories and the rejection of several scientific propositions, including the fact that the earth is warming from greenhouse gases. The effects reported in that paper have since been replicated with a representative sample of Americans. No scholarly critique of either paper has been submitted for peer review to any journal to date"

PLOSone paper:
http://www.plosone.org/article/info%3Adoi%2F10.1371%2Fjournal.pone.0075637;jsessionid=232C19B9866F3CC57583BF805FF9874E
His accompanying FAQ post
http://www.shapingtomorrowsworld.org/lewandowskyFAQPLoS1.htm

PLOSOne data
lhttp://websites.psychology.uwa.edu.au/labs/cogscience/documents/PLOSONE2013Data.csv

Dan Kahan's work and writings (Yale Cultural Cognition Project/blog) has shown that most of the public, left or right politically, do trust scientists, are not anti-science, nor reject science...

only tiny numbers 'reject' science, and without talking to them you don't know why, simple misunderstanding, reacting to an ambiguous question, responding in the negative - due to a leading question, or just wrong.

Science has very little protection form activists scientists using their field to promote their own prejudices, or publishing so called targeted debunking paper' to paper they do not like.

Frontiers got caught with Recursive Fury, and a very sympathetic section editor to Lewandowsky /Cook, which ultimately ended in retraction...

Professor Markram (co-founder Frontiers) described the actions of the authors of that paper, as 'activism that abuses science as a weapon'

that quote is from the comments section at Frontiers by Professor Markram, in a article by Professor Markram taking the authors of Recursive Fury to task (very robustly)

http://www.frontiersin.org/blog/Rights_of_Human_Subjects_in_Scientific_Papers/830

Reply
Barry Woods
8/10/2014 06:24:35 am

I just checked the PLOSONE data and two 14 years olds believed in the moon hoax conspiracy.

I wonder how many 10-17 year olds believed in the various conspiracies in LOG12..


Reply
Barry Woods
2/3/2016 08:04:42 am

Dr Adam Corner (psychologist) whom Lew sent a pre-press release copy, didn't realize it was the lesser effect... so how is anybody else going to decode Lewandowsky's heading?
http://www.theguardian.com/environment/blog/2012/jul/27/climate-sceptics-conspiracy-theorists

Adam wrote about it in the Guardian, with a picture of the moon landing, saying sceptics have to answer to this paper...

"Lewandowsky's research poses difficult questions for the climate sceptic community." - Corner

he also misrepresents it.

"But this is precisely why the researchers targeted this group: in the cut-throat world of climate change scepticism, this is undoubtedly where the action is."

but this is not where the action was - Lew surveyed blogs that hate climate sceptics!

Perhaps Dr Adam Corner's- Green Party - own motivated reasoning got in the way of his critical thinking.
https://www.flickr.com/photos/cardiff_friends_of_the_earth/4190476939/



Reply



Leave a Reply.

    José L. Duarte

    Social Psychology, Scientific Validity, and Research Methods.

    Archives

    July 2017
    December 2015
    October 2015
    September 2015
    August 2015
    June 2015
    May 2015
    April 2015
    March 2015
    February 2015
    January 2015
    November 2014
    October 2014
    September 2014
    August 2014
    July 2014
    June 2014

    Categories

    All

    RSS Feed

Powered by Create your own unique website with customizable templates.
  • Home
  • Blog
  • Media Tips
  • Research
  • Data
  • An example
  • Haiku
  • About