Good point. So, more accurately, don't let the fear that their just might be undiscovered small bugs prevent you from launching.
Fixing that bug is probably less valuable than getting the feature into the hands of users.
Also, don't stress about "losing" users. There are plenty of users and you'll be surprised how forgiving your users will be if you're open about bugs and fixing them.