It is incredibly easy to start a business in the USA.
In most areas, you can form an LLC for $200 or less. If your product is a service or delivery based (not a physical storefront with local customer traffic), you may be able to legally operate from a home office without a business license.
Getting started is easy, succeeding is a little more difficult. The single biggest hurdle most technical people face is probably marketing and/or customer relations --- finding paying customers and dealing with them in order to actually get paid.
Techies often have a glaring lack of real world experience in this area --- which may or may not be a significant problem depending on the nature of your business.