Hacker News Reader

I am curious about how much Dropbox pays for data ingress/egress, they migrated storage to their own on premise data center, then now moving data back to S3 for the data lake.

View on HN

That's analytics data, not file storage. If they have 34PB of analytics, they certainly have far more than that of blob storage.

Definitely much more of user data storage. More about that https://dropbox.tech/infrastructure/inside-the-magic-pocket.

Happy to take other questions.

Did you consider building a S3 API in front of Magic Pocket so it could also serve as your analytics storage?

Or is your compute so bursty that it's more beneficial to be in the cloud on EC2 than to host on prem compute in front of Magic Pocket?

I thought they were almost entirely on prem for the actual storage

See https://github.com/rockset/rocksdb-cloud

Amazon has hard-disk products for large transfers. Snowcone, Snowball and Snowmobile.

Reply on news.ycombinator.com