Hacker News Reader

Comment by MagnumOpus | Hacker News Reader

> Hard drives with 100TB capacity in a 3.5-inch form factor were recently announced

That is an April Fools story.

(Of course you can still get a Synology DS2411+/DX1211 24-bay NAS combo for a few thousand bucks, but it will take up a lot of space under your desk and keep your legs toasty...)

View on HN

Earlier this year, Seagate were showing off their 60 TB SSD[1] for release next year.

So 100 TB in a single drive isn't too far off.

EDIT: Toshiba is teasing a 100 TB SSD concept, potentially for 2018 [2]

[1] 11th August - http://arstechnica.co.uk/gadgets/2016/08/seagate-unveils-60t...

[2] 10th August - http://www.theregister.co.uk/2016/08/10/toshiba_100tb_qlc_ss...

60TB at 500Mb/s transfer will take +1 day to read the data. This is the problem of drinking the ocean through a straw. Even with SSD transfer rates, is still a problem at scale. Clusters give you no only capacity, but also multiplication factor for transfer rates.

Just use 24 of them interleaved/stripped and it will take just one hour for loading the data.

But then you need small disks (eg. 2TB). My point is that huge capacity drives are not appropriate in compute environments, as Hadoop is. They're more for cold storage.

Putting a 100TB of storage on your network isn't hard though. There are off-the-shelf NAS servers that big - eg http://www.ebuyer.com/671448-qnap-ts-ec2480u-rp-144tb-24-x-6...

Reply on news.ycombinator.com