麻豆影院

After three years, Brandon Stell reveals role in establishing controversial website

The mastermind behind a formerly anonymously run website that serves as a crowd-sourced watchdog of peer-reviewed scientific journal articles turns out to be Brandon Stell, a 1997 graduate of the 麻豆影院.

Stell recently disclosed that he is the architect of听, the controversial online public forum where scientists can anonymously critique each other鈥檚 published research. The site鈥檚 users have exposed many errors in published works.

The idea for PubPeer originated when Stell was an undergraduate at CU-麻豆影院 studying ecology, populations and organismal biology. Stell regularly attended meetings to discuss recently published research.

The discussion groups dissected papers, scrutinizing each experiment and conclusion. This in-depth review of peer-reviewed research always revealed a few flaws.

鈥淚鈥檝e never been to a journal club meeting that didn鈥檛 turn up one or two issues about a paper,鈥� says Stell.

Stell enjoyed the occasionally brutal discussions, but he left the meetings disappointed. The insights, remaining questions and possible flaws regarding the research hung in the air with no resolution.

鈥淚 always thought that the authors could maybe clarify an issue if they had a voice at the journal club, but they didn鈥檛. And, when issues were brought up in the meeting, no other scientists in that field ever heard about it,鈥� says Stell.

鈥淭hat is really important because scientists build off of each other鈥檚 work.鈥�

Stell longed for a centralized, public forum for scientists to discuss and critique each other鈥檚 published research.

The idea that grew into PubPeer percolated for years. Throughout his graduate studies in neuroscience at the University of California Los Angeles and a post-doctoral fellowship in Paris, Stell ranted about this idea in hallways, perpetually asking colleagues why someone else hadn鈥檛 already launched such a forum.

He even contacted Google Scholar, a specialized search engine for academic and scholarly literature, hoping to encourage it to establish such a site. His email went unanswered.

He caught a break when Richard Smith came to work in his lab in Paris. Richard and his brother George, who provides technical expertise, helped Stell launch the site in 2012. (PubPeer has revealed the brothers鈥� names but not their professional affiliations.)

The site published anonymous critiques for an obvious reason: Criticism is rarely complimentary. And because peers in the same area of expertise review one鈥檚 research, any critique carries the risk of offending a colleague. This could have significant consequences for the critic鈥檚 career.

鈥淚f some of my colleagues鈥� papers were critiqued, people who were reviewing my grants and my papers and basically deciding my career, if their papers were being critiqued on the site and they knew that I was behind the site, they probably wouldn鈥檛 be very happy about that,鈥� Stell explains.

鈥淚t would also put pressure on me to remove comments that people were unhappy with. So, we were anonymous, and because we were anonymous, it made it difficult to promote the site. You can鈥檛 really do that anonymously.鈥�

Despite the anonymity and lack of promotion, the site gained popularity. In fact, once anonymous commenting was enabled, the site鈥檚 use more than tripled in less than two years (). One success of PubPeer is that it allows other scientists in a field, who are building on that published research, to learn about other researchers鈥� critiques and concerns.

鈥淲hen there are problems that are noticed, then other scientists [in that field] are aware of it颈尘尘别诲颈补迟别濒测听because there鈥檚 now this forum,鈥� explains Stell.

Stell and colleagues saw that this was going to have broader implications.

鈥淚f scientists don鈥檛 know that there are problems with a research article, this has major cost,鈥� says Stell.

鈥淭here鈥檚 an economic cost 鈥� we鈥檙e wasting taxpayer money trying to reproduce or build on [research] that can鈥檛 be built upon. It also has a human cost because graduate students and post-docs could be wasting their careers trying to build on something that can鈥檛 be built upon. If a student spends three years trying to build on something that鈥檚 not very solid, and in the end can鈥檛 do it, it makes it very difficult for their scientific career.鈥�

With a system like PubPeer, as soon as there鈥檚 a problem with a paper, people who use the research as a foundation for future initiatives, including policymakers, health-care providers, and pharmaceutical companies know about it.

Additionally, PubPeer provides an avenue for focusing scientists鈥� attention on the fundamental issue: science.

鈥淲e thought, if we could create this community where people are discussing science that will take the focus off of where science is published and put it on the content or the data that we鈥檙e publishing,鈥� explains Stell.

鈥淚 feel that scientists are on the edge of an interesting moment in science where we鈥檙e collectively questioning the role of journals.鈥�

鈥淧ublication is not the end of the road,鈥� according to Stell. 鈥淚t鈥檚 not, 鈥極K I鈥檝e been through the review and publication process, the paper鈥檚 now in a coveted research journal, I can cash it in for jobs, or grant money.鈥欌��

鈥淚f the data aren鈥檛 solid, there鈥檚 a conversation that鈥檚 going to happen about that.鈥�

Roni Dengler is a writer for CU鈥檚 Science Buffs blog and a Ph.D. candidate in the Molecular, Cellular and Developmental Biology Department.

听