Whether or not people regret this probably depends on personal utility, but I think the way most people think about this (and the standard startup advice) hasn't caught up to the new reality.
VCs don't invest in breakeven, or slightly ahead of breakeven companies. They would rather force a product move by the company to try to make more money for the stakeholders, even at the risk the move kills the company OR hurts the customer's privacy/UX experience. Case in point, Facebook.
One other area in which people will regret taking investment money if they are not careful is at the time of exit. Many company owners who seek investment money don't realize just how quickly they are dilute themselves. While this won't put the company out of business, it may put an individual out of the business of running a second startup. It is wise to be careful taking investment money.