New preprint arguing against the usefulness of preregistration. Authored by open and replicable science proponents.
Counter arguments on Twitter:
1 Like
Chris Chambers and others brought up the fact that clinical trials have been mandatory preregistered since 2005 and argue that it sure ain’t redundant in those cases.
1 Like
So, for those of you who missed it or are not on Twitter, this debate in the open and replicable science community is another one that was tagged #bropenscience. This tag is used to indicate that the open science movement is broken due to lack of diversity: more specifically, that the open science movement has too many white men on the frontline.
Prof. Chris Chambers was highly criticised for his tweet (see above) and for his refusal to apologise to the authors of the papers for what he tweeted. It was (implicitly) argued that Chris would never have called it “trolling” etc had the paper been written by men or by a senior researcher.
In addition was Prof. Brian Nosek once again highlighted as an example of #bropenscience for tweeting this implicit criticism of the preregistration paper:
I think it’s a very unfortunate development that controversial scientific proposals cannot be harshly criticized without the critic being accused of #bropenscience etc in case the criticised researcher in any way could be considered having lower status than the critic. 
1 Like
Hi @rebecca, could you please link to a tweet that labels Brian Nosek as an example of #bropenscience? I cannot find that…
1 Like
These are the ones I mainly thought of:
https://twitter.com/djnavarro/status/1190456304751403009?s=20
The way I interpret these tweets is a bit different than you, then: I don’t think Nosek is singled out here as a “bro”.
The first tweet (by Prof. Richmond) refers to the thread in which you can find some dismissive criticism on the preprint, but Nosek did not provide his point of view there (he did it here).
The second tweet (by Prof. Navarro) tags Nosek as well as other leaders of the open science movement (interestingly, not only white men) and asks whether unsubstantiated, dismissive comments are acceptable in this movement.
My point here is that the situation is much more nuanced than simply “controversial scientific proposals cannot be harshly criticized without the critic being accused of #bropenscience”, as you wrote. The way I see it, it’s about how scientific criticism is conveyed… and it’s written nowhere that it needs to be harsh (as in, impolite and/or attacking the person instead of the content). It is a choice.
I personally choose to think carefully about how I say something, not only what I say. I have noticed that such a communication strategy makes me more effective (i.e., people listen) and, dare I say, more relaxed. This is not a war, we are largely agreeing on many topics, and it would be a pity to be dismissive with each other. I hope I made my point clear, and I am curious to hear your opinion.
3 Likes
First, thank you @antonio.schettino for disagreeing with me! Discussions get so very boring and stagnant when people only agree. 
I’m a big fan of irony, sarcasm, and occasional bad words when used in a particular way. James Heathers and Chris Chambers are two people I often find it very amusing to read. I was surprised and laughed by Chris’ wording, “trolling”, in the original tweet. It made me actually read the Navarro et al paper, which I might not had done otherwise. We had a somewhat similar discussion after the coverage of SIPS 2018 in Vox(?), where James Heathers(?) had said that he wanted to burn things to the ground, which became the title of the article. I loved that coverage, and I remember Chris agreeing when I defended it on Twitter.
We all have different styles in how we say things, and I find that wonderful. Sarcasm and irony can indeed be very difficult to master: occasionally will we be misunderstood. But I don’t think that should mean that we stop using it.
I also love irony and sarcasm, I use them as much as I can… sometimes the results are funny, sometimes they are not 
I am now learning when to use different communication strategies with different audiences: this increases my repertoire while simultaneously allowing my message to penetrate different barriers (e.g., cultural, personal, …).
I also want to point out that the responsibility does not exclusively rest on the sender: the receiver can also be particularly sensitive to a specific (kind of) message. Expecting a sensitive topic to magically go away and never be treated in their presence is obviously unrealistic, but there is often a way to frame it so that it welcomes a discussion and not a fight. That’s the kind of challenge I like, at least in this period of my life… three years ago I would have had a much different opinion 
2 Likes
It was actually Sophia Crüwell who made that comment at the opening ceremony of the conference. James apparently led the chanting of “Bullshit” in a bar later on, when looking at some data or paper.
1 Like
Oh right, I remember now!
Some follow ups on this topic:
An article arguing for the effectiveness of preregistration
Preprint here https://psyarxiv.com/wu3vs/download?format=pdf
And a letter to TICS arguing against that.
https://www.sciencedirect.com/science/article/abs/pii/S1364661319302852?dgcid=rss_sd_all (this one is not openly available yet, you should get it from other sources…)
In general, I think the two manuscripts argue about different things: 1) preregistration as a way to improve inferential statistics processes and tackle questionable research practices and 2) preregistration as a way to improve scientific theories.
I was however suprised by this sentence in the second manuscript: Preregistration is not diagnostic of, nordoes it necessitate, good science. When preregistration is hard, it is hard because it is based on good theory, and good theorising is hard.
Why should a good theory lead to harder pre-registration of statistical methods used to test it?
2 Likes