Meh... It's not quite as easy as one might wish, but I haven't seen any business where it had any significance. If you're small, it's about $300 to start and maybe around $500 for an accountant.
It get's more complicated once you have employees, but even that's not relevant compared to almost any other aspect of a business. I think we're paying EUR30 per quarter for managing the employees taxes and various benefits.
If you're doing GAAP accounting, you're 95% done with taxes as well. And since these standards have converged over the years, the only difference in bureaucracy that remains is people's enduring stereotypes.