This is so wrong (at least as a stereotype).
All throughout my early education I HATED arithmetic, and found almost everything about it mind-numbingly boring and repulsively repetitive. At that point in my life, I hated math. The moment I encountered algebra though, it was "love at first sight", and ever since I've absolutely been fascinated and engaged with every type of high-level math I encounter (the more abstract, the better). And not just "fascinated" in the "I like it" sense -- math, CS, etc. is more easy/natural to me than most humanities subjects, by far.
So although I can only speak for myself, I quite disagree with any claim that the brain isn't naturally suited to abstract thinking. While I know not all people think the way I do, certainly quite a few do.