I couldn't agree more. Hallucinations is truly the biggest problem with these models—you can never be sure whether the response they provide is correct or completely made up.

Even for coding, I prefer snippets more than AI, especially when working on serious app. 

And with the current architecture, it really seems like things will keep getting more and more centralized.

I think some sort of breakthrough is required.