Happens with humans too who make shit up
I tried to learn Kotlin with Copilot. It invents random syntax and imaginary libraries. I end up reading a book in couple of evenings and googled afterword. It was much faster for me. I don’t understand argument “humans also just predict next symbol in their speech”. It only part of our brain does that and for efficiency only. You didn’t used that part of your brain to optimize your new app, right? Why you rely on it while learning?