Oddbean new post about | logout
 I had the most amazing AI fail this afternoon! 

I had a pretty rough transcript of an interview, so I fed it into Claude (and AI that can handle a lot of text), and I gave it a prompt to clean up the transcript (fix punctuation, capitalization, delete obvious filler words like "um," etc.) 

1/x 
 I used "compare documents" in Google Docs to see every change, and it was totally fine for the first 3 pages — great, in fact.

And then it went completely off the rails. It started deleting whole sentences, and by page 14, it was deleting half the text on the page! 

2/x