Military supersonic flight over land in the US only happens over unpopulated areas. Ie, parts of Idaho, Nevada desert etc. Most supersonic training is conducted over the oceans, eg >15nm from the east coast.
Animals panic when they hear the boom: they tend to stampede, fall off cliffs, break legs, trample each other, lambs get separated, break through hedges and into traffic.
The booms were severe enough to occassionally shatter the Royal Doulton in the house, much to my mother's disgust.