You might be interested to hear another point of view. I am one of the people who tells others I'm bad at math, but it is because I struggle with mental arithmetic due to working memory deficits. For example, I struggle to keep two two-digit numbers in my head while I compute their sum. It's embarrassing, so the natural reaction is to try to make it funny.