(1) we have no idea what is going on in LLMs
(2) it's outlandish to claim that LLMs have no understanding of the world

it's hard for both of these to be true.