I have seen it happen. But I have also seen startups skate by. Cost of capital is a real issue, and spending money on being perfectionist is not worth it if you arrived at a good-enough implementation despite being naive and cheapass.
More often it's not "technical debt" but outright failed implementation when technology kills a startup
See how far it takes you and if you are wise enough not to press your luck, you'll have the chance to do it right with cheaper money.