Oddbean new post about | logout
 Oppenheimer's work ushered in a world which is *visible* in a scientific sense. We can see the pre-nuclear world, and the post in the record.

The Manhattan Project literally changed the world.

While its children may be stranger, and more goblinoid than the grimdark that the Cold War suggested, we still live in the shadow of Hirosima & (to a much less extent) Trinity. 2/ 
 What does this have to do with LLMs?

The fundamental question is: "What is your training set; how do you verify it; where do you expect it to be predictive?" 3/ 
 LLMs fudge all of this, and so this becomes a "grey goo" problem.

LLMs are poisoning their own input set, and this is IMO very likely to produce a spectral line.

I think that "Pre-LLM" and "Post-LLM" will be very easy to detect.

And for anything that there are actual $$$ attached to: Never connect it to a public model. 

/end 
 @640e31bb I have made the analogy about physicists needing iron from pre-nuclear age sunken ships to build instruments out of before.