errors marred 2015 study that questioned psychological research
Last Updated : GMT 16:22:18
Arab Today, arab today
Arab Today, arab today

Errors marred 2015 study that questioned psychological research

Arab Today, arab today

Arab Today, arab today Errors marred 2015 study that questioned psychological research

A study that questioned the reliability of scientific research -- named as the third biggest story of the year by Science magazine
Miami - AFP

A study that questioned the reliability of scientific research made huge waves last year, but its key finding was likely overblown because of numerous mistakes in methodology, scientists reported Thursday.

The initial study, published in August in the peer-reviewed journal Science, attempted to replicate 100 previously published studies, and found success just 39 percent of the time.

The results -- named as the third biggest story of the year by Science magazine in its "Breakthroughs of the Year" edition -- "led to changes in policy at many scientific journals, changes in priorities at funding agencies, and it seriously undermined public perceptions of psychology," said researcher Daniel Gilbert, a professor of psychology at Harvard University.

But a new look at the methods of that study suggests it was riddled with errors and may have overestimated the failure-to-replicate rate.

"Readers surely assumed that if a group of scientists did a hundred replications, then they must have used the same methods to study the same populations," said Gilbert.

"In this case, that assumption would be quite wrong."

In some cases, the consortium of 270 scientists known as the Open Science Collaboration (OSC), tried to replicate a study in a different geographic location.

In some cases, this set up the repeat experiment for failure.

- A 5,000-mile testing gap -

One such study attempted to redo an experiment involving racial attitudes at a prominent California University, but using Dutch students who did not have the same cultural attitudes or experiences with the US policy at the center of the experiment, known as affirmative action, aimed at boosting the access of minority groups to higher education.

"They had Dutch students watch a video of Stanford students, speaking in English, about affirmative action policies at a university more than 5,000 miles away," said Gilbert.

It didn't work. But even more troubling, said Gilbert, the research team anticipated that their replication would not work, so they tried it at a US university too. That one did work, but they only included the negative finding in their final analysis, thereby distorting their takeaway message.

"The failure of the replication studies to match the original studies was a failure of the replications, not of the originals," said Gilbert.

Other problems included allowing scientists to choose which experiments they would attempt to repeat, possibly introducing bias to the results.

"All the rules about sampling and calculating error and keeping experimenters blind to the hypothesis -- all of those rules must apply whether you are studying people or studying the replicability of a science," said co-author Gary King, professor at Harvard University.

The Harvard team stopped short of suggesting any intentional wrongdoing by the initial team.

"No one involved in this study was trying to deceive anyone," said Gilbert. "They just made mistakes, as scientists sometimes do."

Indeed, the original team, led by Brian Nosek of the University of Virginia, cooperated with the Harvard team's investigation, Gilbert said.

Nosek wrote an accompanying article in the current issue of Science, in which he agreed with some parts of the critique -- including that "differences between laboratories and sample populations reduce reproducibility."

But he did not entirely back away from his team's findings.

The 2015 study "provides initial, not definitive, evidence -— just like the original studies it replicated," Nosek wrote.

 

arabstoday
arabstoday

Name *

E-mail *

Comment Title*

Comment *

: Characters Left

Mandatory *

Terms of use

Publishing Terms: Not to offend the author, or to persons or sanctities or attacking religions or divine self. And stay away from sectarian and racial incitement and insults.

I agree with the Terms of Use

Security Code*

errors marred 2015 study that questioned psychological research errors marred 2015 study that questioned psychological research

 



Name *

E-mail *

Comment Title*

Comment *

: Characters Left

Mandatory *

Terms of use

Publishing Terms: Not to offend the author, or to persons or sanctities or attacking religions or divine self. And stay away from sectarian and racial incitement and insults.

I agree with the Terms of Use

Security Code*

errors marred 2015 study that questioned psychological research errors marred 2015 study that questioned psychological research

 



Arab Today, arab today
Arab Today, arab today Jordanian woman reveals her project

GMT 00:46 2017 Saturday ,11 November

Jordanian woman reveals her project
Arab Today, arab today Prince's vision spurs new Cornwall village

GMT 03:12 2017 Saturday ,18 November

Prince's vision spurs new Cornwall village
Arab Today, arab today Keep kids busy at Thanksgiving gatherings

GMT 11:14 2017 Friday ,10 November

Keep kids busy at Thanksgiving gatherings
Arab Today, arab today Israel ready to cooperate with Saudi

GMT 06:31 2017 Friday ,17 November

Israel ready to cooperate with Saudi
Arab Today, arab today Airbnb raided by Japan

GMT 01:55 2017 Saturday ,18 November

Airbnb raided by Japan
Arab Today, arab today
Arab Today, arab today
Arab Today, arab today Australian academic's book pulled

GMT 15:20 2017 Monday ,13 November

Australian academic's book pulled
Arab Today, arab today May under Brexit pressure at EU reform summit

GMT 02:14 2017 Saturday ,18 November

May under Brexit pressure at EU reform summit
Arab Today, arab today Delhi half-marathon to go ahead

GMT 03:51 2017 Saturday ,18 November

Delhi half-marathon to go ahead
Arab Today, arab today The history of solar eclipses

GMT 05:16 2017 Sunday ,20 August

The history of solar eclipses
Arab Today, arab today Tesla unveils its all-electric semi truck

GMT 02:59 2017 Saturday ,18 November

Tesla unveils its all-electric semi truck
Arab Today, arab today Baidu speeds up AI progress

GMT 11:46 2017 Friday ,17 November

Baidu speeds up AI progress
Arab Today, arab today Hanan Metawe denies apology for “Major Treason”

GMT 12:22 2017 Thursday ,16 November

Hanan Metawe denies apology for “Major Treason”
Arab Today, arab today paObama climate envoy slams Trump's rejection

GMT 16:04 2017 Friday ,17 November

paObama climate envoy slams Trump's rejection

GMT 08:06 2017 Wednesday ,15 November

Ayten Amer happy for “The Flood” success

GMT 11:15 2017 Thursday ,16 November

Angola oil boss sacked by father's protege

GMT 18:41 2017 Friday ,20 October

Designer Aql Faqih aspires to innovation

GMT 11:38 2017 Wednesday ,15 November

Unloved vultures fight for their survival

GMT 11:49 2017 Thursday ,17 August

Egyptian artist presents new collection of designs

GMT 06:13 2017 Friday ,17 November

Pope denounces healthcare inequality

GMT 05:18 2017 Thursday ,16 November

Boeing announces $27bn from flydubai

GMT 17:12 2017 Monday ,07 August

Al-Shawaifi reveals secrets of total solar eclipse

GMT 16:53 2017 Tuesday ,05 September

Youssra depended on colored foam
Arab Today, arab today
Arab Today, arab today
 
 Arab Today Facebook,arab today facebook  Arab Today Twitter,arab today twitter Arab Today Rss,arab today rss  Arab Today Youtube,arab today youtube  Arab Today Youtube,arab today youtube
arabstoday arabstoday arabstoday arabstoday
arabstoday arabstoday arabstoday
arabstoday
بناية النخيل - رأس النبع _ خلف السفارة الفرنسية _بيروت - لبنان
arabstoday, Arabstoday, Arabstoday