Hacker News Reader

Comment by bps4484 | Hacker News Reader

How do you manage this? In my experience ephemeral storage is about 8GB. Are you able to just parition all data so that you never reach this limit, or is there a way to increase ephemeral space that I don't know about?

PS great article

View on HN

As others have pointed out, all EC2 instances come with large ephemeral volumes already attached as /dev/sdb, etc; you just have to mount them:

http://docs.amazonwebservices.com/AWSEC2/latest/UserGuide/In...

Even the smallest instances have 160GB of storage, all the way up to 3TB on the cc2.8xlarge. New high I/O instances have 2TB of "holy shit fast, destroys my $1000 enterprise SSD" storage. (just tested it last week)

New high I/O instances have 2TB of "holy shit fast, destroys my $1000 enterprise SSD" storage.

Just a tongue-in-cheek comment: Those instances also cost over $2000 USD per month. For the same money you could buy a new Dell Server with 2-4 SSDs, every month. ;)

Lol, very true, but for 3-4 hour workloads they are perfect- which I think is one of the "makes the most sense" kind of EC2 workloads.

In this case, I had about 8 million output files from a Hadoop job that I needed to process with MySQL- it was perfect!

THey're only $2000 if you don't have reserved instances.

Each EC2 instance type has a different amount of ephemeral storage, from 160 GB to 3.3 TB. You need to arrange for it to be mounted when you launch the instance.

a different amount of ephemeral storage, from 160 GB to 3.3 TB

Except for t1 and m3, which have zero ephemeral storage.

Reply on news.ycombinator.com