a) A Formal System consisting of Set of Objects, Operations, Mappings, Axioms and Logic Rules. We invent the symbols and notations to express these.
b) A Domain of Discourse/Interpretation in which the above is applied to map to "Reality".
We Humans have an innate sense of Quantities, Proportion, Objects and Relationships which is what can be called the "Mathematical sense". Even the most uneducated goatherd can count his goats (eg. using pattern-matching with one stone per goat) without knowing anything about the number system. He can also compare his bunch with his neighbour's and tell you which is larger. If you throw a ball at him he can estimate its trajectory and move accordingly to catch it. We have merely abstracted out the essentials from the above and modeled them as Set Theory, Integer/Real Number lines, Rate of change of one quantity w.r.t. another etc. and labeled these as "Mathematics". The models are by design "abstract" but once applied to a "domain" become concrete.