Indeed, LLMs are nothing but Elizabots on cyber-steroids. They don’t understand anything, have no ability to handle concepts or processes in a genuinely abstract space, and are the lazy person’s go-to for quick and convenient pseudo-solutions.
As Nyarlathotep stated in a different thread:
which is possibly the most succinct objection to LLMs I’ve encountered to date.