This. I've traveled quite a bit before building my startup and I can attest to A) how distracting the experiences across the world are (why travel and bring work from your country of origin and not travel and work in your destination country, bartending or cleaning dishes, something more cultural?) and B) how
involved building a startup is.
With a small, niche, business; I can see it happening no doubt. Like running a small remote consultancy or e-commerce site selling drop shipped products. But a startup needs its founders present, communication face to face is unbeatable and often times your cofounders aren't set to travel the world with you.
So, what's my advice? Live some life while you're building your startup, man; go on short trips, go to Burning Man, visit Prague or fly to the B.V.I for four days. Be sure you have some fun. Once you've either succeeded in making FU money from your startup, or your startup has failed, then go experience the world (you don't need FU money to see the world, hence why you do it even if your startup fails).
My plan? Either FU money, passive income, or a failed startup. Once one of those things happen I'm planning on crewing on a sailboat to get to Europe (or SA, or Aus) and living life for a while outside of the USA (think...years).