It is true that many people who are not diagnosed with autism have quite terible theory of mind to.
But it seams like you are missing a part of what poor theory of mind means here. It means that you don’t understand yourself and your own minds tendencies just as much as you don’t understand other peoples perspectives.