Ship too late and none of it will matter.
Shipping quickly is important but it's also important to write quality code. Small bugs that can easily be fixed are fine but security problems or bugs related to payments, for example, are not.
These are not figures you want to see on your bottom line.