It
is easy and cheap starting up a limited liability business in Sweden. I haven't done it anywhere else, so I can't compare. But it certainly is not difficult or expensive in any absolute sense.
Filing taxes is also easy, you don't need an accountant to get it right (but it might still be a good idea).
Doing business with other small(ish) companies is casual and uncomplicated. Contracts are short and to the point. You don't need to consult with lawyers about anything. (But if you have no previous experience at all of "doing business", you should definitely find someone to mentor you on this topic. There are plenty of local business support organizations that provide this essentially for free).
Hiring and firing is easy, if you sign up with a national collective bargaining agreement. With the CBA you don't just get arbitration and well-understood rules, you also get pensions and various useful staff insurances set up in an excellent default manner. You can also do without CBA if you know what you are doing (especially if you are either going for an very senior and well-paid staff who don't care or are bent on taking advantage of second rate juniors).
It is not really hard to find competence of any kind in the "major" cities, if you are prepared to treat and pay them well. Getting X engineers with skill Y at salary Z will of course be difficult for some values of Z. But, salaries in IT are quite low compared to Germany. EUR 5k/month is probably around top 10% for software engineers on the west coast.
People still moan and complain, of course.