Facebook's new optical storage solution [video]
facebook.com
facebook.com
Actually, I'd be very surprised if this wasn't the case (pun intended).
1) As blu-ray is a consumer product its probably manufactured in greater quantities than backup grade tapes, and therefore can be had lower in price, and there are more vendors to source them from. Similarly the drives themselves are cheaper.
2) Tapes aren't random access, therefore it's slow and cumbersome to retrieve single files.
Re: 2) Although it would take an hour or so to search through an entire tape if all the files were written in a single session, normally backup software writes files in sessions containing a few GB. You can seek to a specific session in about 30 seconds average. So if you put about 4GB per session, it would take a max of approx. 30 seconds to read in that session to retrieve a file. So figure about a minute to retrieve any file. Also, LTO5 transfers about 140MB/sec, vs. 6x BDR disks (what I'm seeing for cheap right now) is only 27MB/sec.
http://en.wikipedia.org/wiki/Linear_Tape_Open#Tape_durabilit...
How many 8" or 5.25" floppy disk drives are around today and usable with current server hardware? Anyone who is considering cold storage on media for more than 10 years lifespan is fooling themselves.
A few years ago I had a customer who had to perform data migration from DLT to LTO-3. That was over 24 month project and customer begging the vendor to provide a few old DLT drives to read. On top of that the provided DLT drives were so finicky communicating with modern server hardware that they barely kept up for a few hours before going offline.
That said, I'd prefer to have as much headroom possible, if data is to be stored reliably.
5 years before migrating, with a 15-20 year window vs 5 years before migrating, with a 50-100 year window
Probably a better recovery rate, at their scale.
Today's Blu-Ray drives are perfectly capable of playing an audio CD from the 1980s, and compatible players probably will continue to be available for another 10-20 years even after everyone stops buying content on physical media.
I wouldn't be surprised if I can plug in my USB 3.0 CD/DVD/Blu-Ray combo drive into a USB 7.5 port in 2030 and use it to play an audio CD from 1980, provided that the disc is in good condition. That's a lifespan of 50 years!
Even in the digital age, well-designed and highly forwards-compatible forms of physical media can last a long time.
Enemy #1 in a large data center is power. When he mentioned the entire rack pulls 1,000W for the density suspected in this thread (~500TB to ~1PB), that piqued my interest. Even if you can't push 2-3PB per rack, the top stat you're crunching forever and always is watt-per-gigabyte. Space is important but if it breaks into the top spot you've done something else wrong along the way.
Enemy #27 for cold(ish) storage might be, say, pressure per sq. in. on your floor. I'd be interested to see a weight comparison of a fully-loaded LTO/cartridge rack and this design.
Perhaps not what you were looking for in an answer, but I'm interested to look over the schematics.
"where data is stored on disk but almost never read again, like legal data or backups of third copies of data — keep on increasing dramatically, there are huge demands for developing some form of cold storage system with the highest capacity and the lowest cost."
Its okay for Facebook and other single entities for backups. However for Glacier, it would mean throwing away the disk whenever someone deletes their data. It would also means constant replacement of disks.
Probably not a huge concern, given the use case. Glacier is pretty fire-and-forget.
> It would also means constant replacement of disks.
They're already doing that with servers, why would disks be a problem?
Optical jukeboxes/libraries for MO/DVD/CD used to be popular a decade or so ago and now considered antique. There is just not enough density with optical.
The drives are spun much slower than a regular drive (I've heard 300rpm) and so they can be crammed into much higher density racks without worrying about heat.
Maybe data is eventually moved to tapes for Glacier; I am privy to no special information.
Or maybe its just a nice content delivery mechanism to the NSA. Just ship a bunch of blue-rays instead of pesky optical fiber interception.
If anyone can provide a link to BD media for sale at a price that make this economical I'd be interested to know.
> 1 Rack = 44 magazines; 1 magazine = 36 cartridges; 1 cartridge = 12 blueray discs. So, ~950TB.
24 mag -> 36 cart -> 12 disks
10,368 Disks in total per rack
This was a bit disappointing.
Could be also an add-on service to existing online backup business.
Do you have any links on the methodology used to measure the 30+ or 1000yr grade for a blu-ray ?
Really, Facebook? It's 2014.