Starting anything is easy, it's the making something that's wanted and making it work successfully and profitably that's exceedingly hard. Most don't realize this until they've been punched in the face by the real world of startups (as yours truly has been).
Becoming your own boss is probably the worst reason to pursue entrepreneurship imho. Having a manager is wayyy easier, even if that means you have less control and autonomy.
But by all means, try...