"...nothing that I have read, verified or done gives me any compelling reason to believe that LLMs do reasoning/planning as it is normally understood. What they do, armed with their web-scale training, is a form of universal approximate retrieval which, as we have argued, can sometimes be mistaken for reasoning capabilities."

https://cacm.acm.org/blogs/blog-cacm/276268-can-llms-really-reason-and-plan/fulltext