I also this that these conceptual models are probably the biggest reason AI/LLMs/ML will be a big problem. People aren’t wired to defend against these tools.
Maybe having heard and read — at an impressionable age — Douglas Adams’ seminal The Hitchhiker’s Guide to the Galaxy, in which the answer to the objectively unanswerable question as to the meaning “of life, the universe, and everything?” is presented as the highly computer-centric “42” inoculated me to all this somehow at some level. Or maybe it’s that I’ve been building websites since before Google existed, so I’ve been watching the sausage-making too long to fall for it.