麻豆影院

CU-led task force calls on scientists across the nation to improve practices

Scientists are having trouble reproducing each other鈥檚 published findings. This growing problem has received national attention and is concerning policymakers, the public and scientists.

CU-麻豆影院 biologist Mark Winey, a professor and chair of the Molecular, Cellular and Developmental Biology Department, wants to solve this problem.

He leads the Data Reproducibility Task Force, a group established by the American Society for Cell Biology (ASCB). This task force unites other prominent life scientists from around the nation in an effort to find solutions.

"The public wants to know that its tax dollars that are being spent on听research are being used responsibly, and being used in a way that鈥檚 going to lead to cures and new technologies.鈥�

Winey and the task force identified some major contributors to the reproducibility problem, including a competitive 鈥榩ublish or perish鈥� mentality, a lack of common procedural standards and communication issues among scientists. They recently published their findings and suggestions for improvement in a听white paper.

鈥淭he public wants to know that its tax dollars that are being spent on听research are being used responsibly, and being used in a way that鈥檚 going to lead to cures and new technologies,鈥� Winey says, explaining the significance of the problem.

鈥淭he ability to replicate scientific findings is very important听to the scientific method and getting to those cures and new technologies.鈥�

A major goal of the task force was 鈥渢o assemble a group of scientists to talk about the problem and to try to identify what the issue might really be.鈥� Then, once they had an idea, to ask: 鈥淲hat would a bunch of scientists want to do about it? How can scientists address the problem and improve the current quality science?鈥�

To answer these questions, the task force surveyed hundreds of members of the ASCB, mostly working scientists. Most of these scientists indicated that the fiercely competitive scientific culture is partially to blame.

With funding for biomedical research at a historic low, the pressure to publish one鈥檚 findings is immense. Jobs, salaries, and promotions rely almost exclusively on a scientist鈥檚 publication record.

Plus, more weight is given to scientists who publish in well-known journals. According to the survey, the demand to publish may lead to 鈥渉yping鈥� results to create a high-profile story.

Another problem identified by the survey is lack of communication among scientists. In particular, researchers need to talk about creating standard ways to perform procedures.

The idea is simple: If researchers follow the same procedures, the likelihood that they will be able to reproduce one another鈥檚 work increases. In current practice, however, most scientists do experiments in slightly different ways.

Publishing practices also muddle communication. The sections of scientific research articles describing experimental methods formerly contained all the information other scientists would need to carry out an experiment in precisely the same way.

Today, 鈥渕ethods sections鈥� are much shorter and often lack the details necessary to retest an experiment.

But the news isn鈥檛 all bad. Despite several well-publicized examples of fraud, lack of scientific reproducibility has little to do with deception, according to survey results. Scientists also report being able to solve their own problems.

鈥淥ne piece of good news is that a lot instances of reproducibility problems are resolved, and they鈥檙e resolved amicably between the two labs, so we were really pleased with that,鈥� says Winey.

The task force published findings from this survey in their white paper, along with 13 recommendations for how to improve scientific practices.

Among these recommendations, the paper highlights new initiatives, such as web-based forums, which encourage scientists to communicate with one another. It also emphasizes better publishing practices鈥攊ncluding more detailed methods sections鈥攁nd calls for scientists to share protocols and agree upon standard ways to perform procedures.

Finally, it aims to empower scientists to change the current, competitive culture, and recommends more focused education on responsible research and fair interpretation of data.

Winey and the task force met their initial goal of identifying some of the issues behind the reproducibility problem. According to task force member and UC Berkeley biologist Doug Koshland, it鈥檚 too early to tell if the task force has succeeded in improving reproducibility, though there鈥檚 a plan in place to track the initiatives proposed in the white paper.

鈥淭he ASCB and the [ASCB鈥檚] public policy committee are working to follow up on the recommendations,鈥� says Koshland.

Aggie Mika and Roni Dengler are writers for CU鈥檚听Science Buffs听blog. Roni is a PhD. candidate in MCD Biology, and Aggie is fourth year graduate student in Integrative Physiology.