Breast used to be (and to some extent still is) gender neutral, think of breast plate armor etc. Similar shifts also happened in other languages where the word for the upper front torso area is euphemistically substituted to mean specifically the female breast anatomy on top of said area.
But this shift already happened in the 18th century, so today's intuition is also different.