YC did not have prestige in their early years (Jessica mentions they had to beg their friends to come to demo days). Yet people were dropping out of Harvard to join. So it seems prestige is not necessary for success and in fact may be a negative signal.