I talked to jeff barr @amazon a while back about these kind of issues (if you have large datasets to shuffle on/off EC2, is there an efficient & cost effective way to do it?) - shoot him an email or comment on the aws blog so they know more people have this need. Amazon public datasets can help with this for some use cases, for example certain bioinformatics or other academic use cases.