If you take to time to set up incremental compilation, it's really quite fast. For reference, updates to the vscode repo (~5k files) take generally <300ms to recompile, and even incrementally updating after pulling in a batch of hundreds of commits takes only ~10 seconds.
It's concerning to me that the deno folks chose giving up on type safety over figuring out how to set up their development environment to better meet their needs.