It seems inevitable that seeds of every plant will be in gardens of every conceivable corner of the earth.
Not inevitable at all. Try arriving in Australia with a piece of fruit in your hand luggage, or try arriving in New Zealand with mud on your walking boots, and see what happens.