Oddbean new post about | logout
 All these Ariely stories remind me of the Innovator’s Dilemma guy, Clayton Christensen. He has his whole story about milkshakes, doing a job for truckers that has been told and retold in varying watts, and doesn’t seem to be based on reality. Nobody’s ever called him out for it. All of these behavioralists who consult seem to me to be myth makers. 
 Completely unrelated, I used to work alongside several pathological liars (either 2 or 4, depending on definitions; all 4 were liars), and you get to know the tells really really well. No story is ever told the same way twice even to the same person. When questioned, the teller comes up with an entirely different explanation instead of ever admitting the thing didn’t happen. 
 Listen, I was once friends with Mike Daisey. When shit came out, I was not “No, despite all evidence, Mike is absolutely an honest person,” because, you know, he was not. (In fact, when he started talking about Chinese manufacturing, I had a distinct whiff of ordure.) 
 One of the most remarkable things to me about all these studies that turn out to have misused data, etc., is that most researchers apparently keep incredibly poor records; there's no audit history for changes; Excel is somehow the gold standard. I guess that's true in business, but I somehow thought there would be university, journal, and professional standards that required very specific one-way archiving of data, etc. 
 @bb1a99d2 😬 🤐 
 @cef5b5fc I am surely naive but after this many years, it's incredible 
 @bb1a99d2 From my experience in industry, keeping intermediate copies of data is prohibitively expensive, even if you only keep one copy per day. 
 @eab3a90d I don't think most research data in social sciences is bulky or changes day to day! 
 @bb1a99d2 
Every PI receiving a grant is their own little small business and it is a free for all. Depending on the nature of the grant, their may be some rudimentary training in ethics (i.e. a training grant), but most training on data retention, figure production, and writing is left to the PI. Some journals do have articles explaining acceptable image adjustments, but they are few and far between. 
 @bb1a99d2 The university standard for specific, one-way archiving of data last I was there was called "Final_Final_Final_V2". 
 @bb1a99d2 @ed044e85 ditto journalism. I’ve been thinking about data libraries, version control and reproducibility a bit lately (and for my whole career). The combination of scant interest, requirement for *some* specialist skill, and poor tooling makes it a challenging task https://elvery.net/drzax/building-and-managing-a-personal-professional-data-library/ 
 @bb1a99d2 we're trying to improve things but there's a lot of work to do
https://osf.io/4pd9n/ 
 @bb1a99d2 
There are a few journals that actually check code for reproducibility - this is one of the pioneers: https://odum.unc.edu/archive/journal-verification/ 
 @bb1a99d2 was it an agony or an ecstasy? I remember listening to that episode of This American Life, and thought it sounded too well-written and not quite “right”. Listening to the retraction on This American Life a few weeks later, it sounded like they had fallen for it and were somewhat pissed off at Daisey. But I sincerely hope that that little stunt cost him his reputation 
 @297fb9e6 He apologized, did the on-air follow-up, then apparently claimed he was forced to, etc. His monologist career is still going quite well, apparently. 
 @bb1a99d2 Is there some new news? 
 @c3f6e3f1 Just thinking about pathological liars (see thread!) 
 @bb1a99d2 I happened to have an off-the-record meeting with Tim Cook right after all the holes got poked in Daisey's Apple stuff. I think I brought it up. It's the only time I've ever talked to him. 
 @a7fefd93 It’s sad because Mike is an absolutely brilliant monologist. Love his work. His Amazon show was more clearly impressionistic. I knew some parts were enhanced or fabricated. I wish he hadn’t felt the need to report. 
 @bb1a99d2 @a7fefd93 Agreed. I've seen him in D.C. a few times over the years. 
 @bb1a99d2 In a remarkable coincidence, I was just finishing an excellent YouTube video about Ariely's fraud as I read this. The horrifying kicker was that he continues to publish and remains at Duke 
 @927c035f I mean, between the New Yorker and the New York Times one-two punch, it is going to be hard for any institution to ignore the data. 
 @927c035f @bb1a99d2 Welp… I loved both of their books because they changed my life and now I gotta re-evaluate some stuff, dammit. 
 @308c540a @927c035f I was a big fan of Ed Catmull and his book until I discovered he (allegedly…some of it is in depositions) was part of the massive anti-poaching and salary fixing agreements across most of the big animation houses. Can't trust a man like that who writes about respect and stabs workers in the back. 
 @bb1a99d2 Did . . . did his milkshakes bring all the boys to the yard