Arab Today, arab today errors marred 2015 study that questioned psychological research
Last Updated : GMT 01:30:09
Arab Today, arab today
Arab Today, arab today

Errors marred 2015 study that questioned psychological research

Arab Today, arab today

Arab Today, arab today Errors marred 2015 study that questioned psychological research

A study that questioned the reliability of scientific research -- named as the third biggest story of the year by Science magazine
Miami - AFP

A study that questioned the reliability of scientific research made huge waves last year, but its key finding was likely overblown because of numerous mistakes in methodology, scientists reported Thursday.

The initial study, published in August in the peer-reviewed journal Science, attempted to replicate 100 previously published studies, and found success just 39 percent of the time.

The results -- named as the third biggest story of the year by Science magazine in its "Breakthroughs of the Year" edition -- "led to changes in policy at many scientific journals, changes in priorities at funding agencies, and it seriously undermined public perceptions of psychology," said researcher Daniel Gilbert, a professor of psychology at Harvard University.

But a new look at the methods of that study suggests it was riddled with errors and may have overestimated the failure-to-replicate rate.

"Readers surely assumed that if a group of scientists did a hundred replications, then they must have used the same methods to study the same populations," said Gilbert.

"In this case, that assumption would be quite wrong."

In some cases, the consortium of 270 scientists known as the Open Science Collaboration (OSC), tried to replicate a study in a different geographic location.

In some cases, this set up the repeat experiment for failure.

- A 5,000-mile testing gap -

One such study attempted to redo an experiment involving racial attitudes at a prominent California University, but using Dutch students who did not have the same cultural attitudes or experiences with the US policy at the center of the experiment, known as affirmative action, aimed at boosting the access of minority groups to higher education.

"They had Dutch students watch a video of Stanford students, speaking in English, about affirmative action policies at a university more than 5,000 miles away," said Gilbert.

It didn't work. But even more troubling, said Gilbert, the research team anticipated that their replication would not work, so they tried it at a US university too. That one did work, but they only included the negative finding in their final analysis, thereby distorting their takeaway message.

"The failure of the replication studies to match the original studies was a failure of the replications, not of the originals," said Gilbert.

Other problems included allowing scientists to choose which experiments they would attempt to repeat, possibly introducing bias to the results.

"All the rules about sampling and calculating error and keeping experimenters blind to the hypothesis -- all of those rules must apply whether you are studying people or studying the replicability of a science," said co-author Gary King, professor at Harvard University.

The Harvard team stopped short of suggesting any intentional wrongdoing by the initial team.

"No one involved in this study was trying to deceive anyone," said Gilbert. "They just made mistakes, as scientists sometimes do."

Indeed, the original team, led by Brian Nosek of the University of Virginia, cooperated with the Harvard team's investigation, Gilbert said.

Nosek wrote an accompanying article in the current issue of Science, in which he agreed with some parts of the critique -- including that "differences between laboratories and sample populations reduce reproducibility."

But he did not entirely back away from his team's findings.

The 2015 study "provides initial, not definitive, evidence -— just like the original studies it replicated," Nosek wrote.

 

Name *

E-mail *

Comment Title*

Comment *

: Characters Left

Mandatory *

Terms of use

Publishing Terms: Not to offend the author, or to persons or sanctities or attacking religions or divine self. And stay away from sectarian and racial incitement and insults.

I agree with the Terms of Use

Security Code*

Arab Today, arab today errors marred 2015 study that questioned psychological research Arab Today, arab today errors marred 2015 study that questioned psychological research

 



Arab Today, arab today
Arab Today, arab today Heart of Turkish Riviera is Alluring Seaside Escape

GMT 11:11 2017 Tuesday ,28 March

Heart of Turkish Riviera is Alluring Seaside Escape
Arab Today, arab today 5 Crafty Must-Have Limited-Budget Ideas

GMT 17:03 2017 Saturday ,25 March

5 Crafty Must-Have Limited-Budget Ideas
Arab Today, arab today Russia, Iran ink economic deals

GMT 08:03 2017 Wednesday ,29 March

Russia, Iran ink economic deals
Arab Today, arab today Media host gives priority to problems of people

GMT 07:00 2017 Tuesday ,28 March

Media host gives priority to problems of people
View News in Arabic - Education: كتب ومراجع وأبحاث
Arab Today, arab today
Arab Today, arab today
Arab Today, arab today Disaster costs nearly double to $175bn

GMT 10:42 2017 Tuesday ,28 March

Disaster costs nearly double to $175bn
Arab Today, arab today Campaign fights sexual harassment in Egypt

GMT 11:14 2017 Tuesday ,28 March

Campaign fights sexual harassment in Egypt
Arab Today, arab today Trump moves to roll back Obama climate measures

GMT 08:39 2017 Wednesday ,29 March

Trump moves to roll back Obama climate measures
Arab Today, arab today Prepares to give stargazers an eyeful

GMT 13:38 2017 Monday ,06 March

Prepares to give stargazers an eyeful
Arab Today, arab today Mercedes, VW recall million vehicles in China

GMT 09:16 2017 Wednesday ,29 March

Mercedes, VW recall million vehicles in China
Arab Today, arab today Uber grounds self-driving cars

GMT 09:11 2017 Monday ,27 March

Uber grounds self-driving cars
Arab Today, arab today Trump poised to roll back climate protections

GMT 09:28 2017 Tuesday ,28 March

Trump poised to roll back climate protections

GMT 18:57 2017 Tuesday ,21 March

Accessories designer reveals her new collection

GMT 11:10 2017 Monday ,27 March

Trump to roll back Obama clean power plan

GMT 13:26 2017 Friday ,24 February

Expresses Algerian history by woody figures

GMT 11:55 2017 Wednesday ,29 March

Need ‘gymspiration?’ The top fun fitness bloggers

GMT 09:02 2017 Thursday ,23 March

Laptop ban sparks ire

GMT 06:31 2015 Thursday ,04 June

Pluto's unruly moons

GMT 05:17 2017 Wednesday ,29 March

Samsung to sell refurbished Galaxy Note 7s

GMT 19:27 2017 Saturday ,11 March

Boualsof launches "Priestess Kahina" collection
Arab Today, arab today
Arab Today, arab today
 
 Arab Today Facebook,arab today facebook  Arab Today Twitter,arab today twitter Arab Today Rss,arab today rss  Arab Today Youtube,arab today youtube  Arab Today Youtube,arab today youtube
arabstoday arabstoday arabstoday arabstoday
arabstoday arabstoday arabstoday
arabstoday
بناية النخيل - رأس النبع _ خلف السفارة الفرنسية _بيروت - لبنان
arabstoday, Arabstoday, Arabstoday