Re Amazon, I've done that too and the way it works is you start up an EC2 instance that does the work and sends back info. In my case I sent the info to an S3 bucket and then pulled all the info from that bucket elsewhere once all the machines finished. Ultimately you pay for what you use, and if you only use an hour across a ton of machines and use the cheapest machine it's pretty cheap.
FYI: luminati will give you unlimited bandwidth for like $1/IP/month.
You can easily set up a launch configuration for EC2 that runs a script or program... But with a bit more work lambda will save a lot of money
That depends on your orchestration. AWS provide several tools for running Docker without having to maintain your own EC2 hosts.
> You can easily set up a launch configuration for EC2 that runs a script or program... But with a bit more work lambda will save a lot of money
You could do that via a launch configuration but that would be a pretty naff way of doing it. Baked AMI would be easier but personally I'd prefer ECS (Docker) or lambda. Cheaper, quicker to deploy, lower ramp up times.
Ultimately though, there's no wrong way to do this - just personal preference.
personally i would spin up a million lambda functions and just see what happens. each one def wouldn't get its own ip but maybe you would have good coverage?
Yep - my reason is normally "I'm planning a project that needs more instances"
I doubt they even look at that field to be honest