I believe the main issue that we might face even in the short run is that LLMs depend on content created by humans. When there is no incentive for humans to create new content, where will LLMs get their input? From it self creating an endless loop of "knowledge"?