LLMs are able to do complex logic within the world of words. It is a a smaller matrix than our world but fueled by the same chaotic symmetries of our universe. I would not underestimate logic, even when not given adequate data.
I don't think you understand logic very well btw if you wish to suggest that you can reach valid conclusions from inadequate axioms.