Applying Scientific Method to Scientific Research

Source: Breitbart, Mar 2017

Fewer than 1 percent of papers published in scientific journals follow the scientific method, according to research by Wharton School professor and forecasting expert J. Scott Armstrong.

Professor Armstrong, who co-founded the peer-reviewed Journal of Forecasting in 1982 and the International Journal of Forecasting in 1985, made the claim in a presentation about what he considers to be “alarmism” from forecasters over man-made climate change.

“We also go through journals and rate how well they conform to the scientific method. I used to think that maybe 10 percent of papers in my field … were maybe useful. Now it looks like maybe, one tenth of one percent follow the scientific method” said Armstrong in his presentation, which can be watched in full below. “People just don’t do it.

Armstrong defined eight criteria for compliance with the scientific method, including full disclosure of methods, data, and other reliable information, conclusions that are consistent with the evidence, valid and simple methods, and valid and reliable data.

According to Armstrong, very little of the forecasting in climate change debate adheres to these criteria. “For example, for disclosure, we were working on polar bear [population] forecasts, and we were asked to review the government’s polar bear forecast. We asked, ‘could you send us the data’ and they said ‘No’… So we had to do it without knowing what the data were.”

According to Armstrong, forecasts from the Intergovernmental Panel on Climate Change (IPCC) violate all eight criteria.

“Why is this all happening? Nobody asks them!” said Armstrong, who says that people who submit papers to journals are not required to follow the scientific method. “You send something to a journal and they don’t tell you what you have to do. They don’t say ‘here’s what science is, here’s how to do it.’”

“They’re rewarded for doing non-scientific research. One of my favourite examples is testing statistical significance – that’s invalid. It’s been over 100 years we’ve been fighting the fight against that. Even its inventor thought it wasn’t going to amount to anything. You can be rewarded then, for following an invalid [method].”

“They cheat. If you don’t get statistically significant results, then you throw out variables, add variables, [and] eventually you get what you want.”

“My big thing is advocacy. People are asked to come up with certain answers, and in our whole field that’s been a general movement ever since I’ve been here, and it just gets worse every year. And the reason is funded research.”

Advertisements

2 responses to “Applying Scientific Method to Scientific Research

  1. Really good blog,thank so much for your effort in writing the posts.

Leave a Reply

Fill in your details below or click an icon to log in:

WordPress.com Logo

You are commenting using your WordPress.com account. Log Out / Change )

Twitter picture

You are commenting using your Twitter account. Log Out / Change )

Facebook photo

You are commenting using your Facebook account. Log Out / Change )

Google+ photo

You are commenting using your Google+ account. Log Out / Change )

Connecting to %s