Oddbean new post about login | logout One of the most remarkable things to me about all these studies that turn out to have misused data, etc., is that most researchers apparently keep incredibly poor records; there's no audit history for changes; Excel is somehow the gold standard. I guess that's true in business, but I somehow thought there would be university, journal, and professional standards that required very specific one-way archiving of data, etc.
@bb1a99d2 Every PI receiving a grant is their own little small business and it is a free for all. Depending on the nature of the grant, their may be some rudimentary training in ethics (i.e. a training grant), but most training on data retention, figure production, and writing is left to the PI. Some journals do have articles explaining acceptable image adjustments, but they are few and far between.
@bb1a99d2 @ed044e85 ditto journalism. I’ve been thinking about data libraries, version control and reproducibility a bit lately (and for my whole career). The combination of scant interest, requirement for *some* specialist skill, and poor tooling makes it a challenging task https://elvery.net/drzax/building-and-managing-a-personal-professional-data-library/
@bb1a99d2 we're trying to improve things but there's a lot of work to do https://osf.io/4pd9n/
@bb1a99d2 There are a few journals that actually check code for reproducibility - this is one of the pioneers: https://odum.unc.edu/archive/journal-verification/