If they are catastrophic, you may have to fix them to make progress. But most are not, and you can make other progress. Leaks are not. Cargo should not be dictating your work schedule.
I use todo!() a ton when building as well. Sketching out data types and signatures before diving into implementation details.