That depends on if one of the rocks breaks in half as you throw it onto the rock-pile or not. And also if the resulting piece knocked off is large enough to pass your fuzzy and contextual distinction between "rock" and "pebble".
But IMHO, arithmetic such as counting numbers and 2 + 2 = 4 are not part of the natural world. If I have a rock and another rock, I can with minor effort tell them apart: they have different weight, size, shape, density, composition etc. They are each unique individual assemblages of huge numbers of atoms in distinct never-to-be-repeated arrangements. In what way are these 2 unique things "the same" ?
If I have an apple and you give me a frog, I have an apple and a frog. They're not the same. If I have apple A and you give me apple B, do I have 2 apples? I have unique apple A and unique apple B. We can pretend that they're the same if you like, but that category is in our thinking, not in the world, and we also know that we can also notice differences between them.
tl;dr the natural world is not fungible, but behaving as if it is, is a convenient abstraction for mathematics and commerce, not a property of the natural objects.