This looks kind of interesting:

https://github.com/huggingface/pytorch-pretrained-BigGAN/blo...

When you look further down you find:

https://github.com/huggingface/pytorch-pretrained-BigGAN/blo...

And that's just a quick search for s3 in the repo. It would not surprise me in the least to discover a `from_pretrained` that points at one of the s3 resources being pulled. There's probably other stuff like that as well in the code that could be causing equally nasty heartache .. especially if non-persistent containers are involved....

(This is a WAG aka Wild A Guess)

EDIT: Dug a little more and found:

https://github.com/search?q=org%3Ahuggingface+s3&type=Code

Unless I'm mistaken here, there's a crap ton of code that could be downloading models at runtime ... Which seems significantly less than ideal ...