Any remote data system would have the same problems. Looping over a list and synchronously fetching files one by one is equally foolish for S3 too.