Giving up control is hard.

The real question isn't can you have a firm grasp on the product direction/design wheel at a small company. It's can you build something anyone wants at all.

Secondly, can you make a sustainable business at all?

Just build something people want. The rest might follow.