So when I was in the gifted program, they got real concerned about how I didn't know my times tables and was super slow at a few of them. This was the 1970s, and before I knew binary, so 7s and 8s caused me issues. So I'd figure out 8x8 by going from 6x6=36 (real easy to memorize) and then adding +6+6 to mentally fill out the 8x6 block and then adding +8+8 to fill it out to a 8x8 block (I'm visual/geometrical).
I was the first kid in school to pass the AHSME to get invited to take the AIME though. Being before the internet, and being stuck on an island in Alaska, didn't get me enough exposure to higher math through my own self-direction to get anywhere on the AIME. If you don't live anywhere near a University library and/or don't know you can use it, that'll set you behind (at least back then, these days there's YouTube and sci-hub and friends).
I still think I would have hit a wall anyway with Math, even with perfect exposure, because I'm visual and higher Math seems to require being very good with symbols and memory as well.
I suspect lots of people still underestimate me because my memory is ass, and we associate memory with intelligence so much (e.g. Jeopardy).