I tend to have a preflight script which is run prior to the final docker command. This let's the layers have the cached weights & avoids dealing with downloading or making changes to the codebase for loading downloaded weights. Would shave off 10s from both providers.