Oddbean new post about | logout
 Listen, I was once friends with Mike Daisey. When shit came out, I was not “No, despite all evidence, Mike is absolutely an honest person,” because, you know, he was not. (In fact, when he started talking about Chinese manufacturing, I had a distinct whiff of ordure.) 
 One of the most remarkable things to me about all these studies that turn out to have misused data, etc., is that most researchers apparently keep incredibly poor records; there's no audit history for changes; Excel is somehow the gold standard. I guess that's true in business, but I somehow thought there would be university, journal, and professional standards that required very specific one-way archiving of data, etc. 
 @bb1a99d2 😬 🤐 
 @cef5b5fc I am surely naive but after this many years, it's incredible 
 @bb1a99d2 From my experience in industry, keeping intermediate copies of data is prohibitively expensive, even if you only keep one copy per day. 
 @eab3a90d I don't think most research data in social sciences is bulky or changes day to day! 
 @bb1a99d2 
Every PI receiving a grant is their own little small business and it is a free for all. Depending on the nature of the grant, their may be some rudimentary training in ethics (i.e. a training grant), but most training on data retention, figure production, and writing is left to the PI. Some journals do have articles explaining acceptable image adjustments, but they are few and far between. 
 @bb1a99d2 The university standard for specific, one-way archiving of data last I was there was called "Final_Final_Final_V2". 
 @bb1a99d2 @ed044e85 ditto journalism. I’ve been thinking about data libraries, version control and reproducibility a bit lately (and for my whole career). The combination of scant interest, requirement for *some* specialist skill, and poor tooling makes it a challenging task https://elvery.net/drzax/building-and-managing-a-personal-professional-data-library/ 
 @bb1a99d2 we're trying to improve things but there's a lot of work to do
https://osf.io/4pd9n/ 
 @bb1a99d2 
There are a few journals that actually check code for reproducibility - this is one of the pioneers: https://odum.unc.edu/archive/journal-verification/ 
 @bb1a99d2 was it an agony or an ecstasy? I remember listening to that episode of This American Life, and thought it sounded too well-written and not quite “right”. Listening to the retraction on This American Life a few weeks later, it sounded like they had fallen for it and were somewhat pissed off at Daisey. But I sincerely hope that that little stunt cost him his reputation 
 @297fb9e6 He apologized, did the on-air follow-up, then apparently claimed he was forced to, etc. His monologist career is still going quite well, apparently. 
 @bb1a99d2 Is there some new news? 
 @c3f6e3f1 Just thinking about pathological liars (see thread!) 
 @bb1a99d2 I happened to have an off-the-record meeting with Tim Cook right after all the holes got poked in Daisey's Apple stuff. I think I brought it up. It's the only time I've ever talked to him. 
 @a7fefd93 It’s sad because Mike is an absolutely brilliant monologist. Love his work. His Amazon show was more clearly impressionistic. I knew some parts were enhanced or fabricated. I wish he hadn’t felt the need to report. 
 @bb1a99d2 @a7fefd93 Agreed. I've seen him in D.C. a few times over the years.