True, however Pants right now does not have support with Git to only checkout dependencies it actually needs for the build.
I agree that it should take effectively zero time for me to download and apply 50MB of updates, but poor quality internet is still pretty easy to find (working with plane wifi) -- maybe my coffee shops have worse internet than yours!