Loomio
Tue 1 Nov 2022 1:45PM

Should EarthArXiv do a "null results" contest?

BC Bruce Caron Public Seen by 87

ASAPbio is running a competition for preprints that explain null results. Should we follow their lead? I could probably find the $1000. https://asapbio.org/competition2022

VV

Victor Venema Tue 1 Nov 2022 2:17PM

I do not have the reference, but I have seen a study claim that (at least for climatology) there is no (big) problem. Null results are reported (which for me makes sense as knowing there is no relationship in a science where there are many potential ones is valuable information). The main caveat was that the null results tend to be reported in the paper, while the "positive" results were more prominent in abstracts. I guess it would make a difference whether a paper reports on many results (typical in climatology) or just on one (e.g., an expensive clinical trial).

CJ

Christopher Jackson Wed 2 Nov 2022 8:20AM

I very much like the idea of that, @Bruce Caron, unless there’s a downside to doing it? I guess we’d also want to outline why we were doing it, e.g., to encourage and show the value of reporting such results. Also, we’d need to be clear on the judging criteria…which relates to my preceding point.

BC

Bruce Caron Wed 2 Nov 2022 8:39PM

In any case we can let ASAPbio try it out first... learn from them.

CJ

Christopher Jackson Thu 3 Nov 2022 5:24PM

Makes sense!

CJ

Christopher Jackson Thu 8 Dec 2022 8:34AM

Nice! Spot-on regarding the fact we should attach value to these outcomes. Shared via Twitter.