Not everywhere! Horses were banned in Rome (and many other places) for exactly this reason.