There definitely is such a thing as "mathematical talent", but (a) if you're really excited by math then there's a decent chance your limiting factor is knowledge rather than talent, and (b) there's plenty to appreciate in the subject regardless of how much of it you have. My students come to me at all different levels but if they have enough time and motivation to work on it they all learn a lot of math!
There are also plenty of people in the world who just aren't that into this stuff, but that's not really the population I'm talking about --- unless they have to learn it for some reason, it probably doesn't bother them that much that they don't know a lot of math! And I imagine a good chunk (though probably not all) of this group could probably find something to like in the subject if it was presented in an appealing way.