Do LLMs Reason?

Do submarines swim? [1] Do cars run, like a cheetah does? [2]

[1]: https://www.cs.utexas.edu/~EWD/ewd08xx/EWD898.PDF#page=3

[2]: https://www.youtube.com/watch?v=ipRvjS7q1DI (Richard Feynman: Can Machines Think?)