Hacker News Reader

hemancusoon Show HN: Zero – Local file system transparently swapping to the cloud

We took a beta list to gauge interest. No sense in all the work if nobody cares.

hemancusoon Show HN: Zero – Local file system transparently swapping to the cloud

linux@expandrive.com

hemancusoon Show HN: Zero – Local file system transparently swapping to the cloud

Originally said "coming soon" to see if anyone was interested. Turns out they are!

hemancusoon Show HN: Zero – Local file system transparently swapping to the cloud

Thanks!

hemancusoon Show HN: Zero – Local file system transparently swapping to the cloud

It used to be unlimited but most of the users ultimately desired to offload data and access it on demand. It should be configurable but currently isn’t.

hemancusoon Show HN: Zero – Local file system transparently swapping to the cloud

There is a red heart after "with" - or at least there is on every machine I've tried.

hemancusoon Show HN: Zero – Local file system transparently swapping to the cloud

Yes, unless you're offline - in which case it stays in the cache until a connection is available.

hemancusoon Show HN: Zero – Local file system transparently swapping to the cloud

https://twitter.com/expandrive/status/1000012200612950017

Yup!

hemancusoon Show HN: Zero – Local file system transparently swapping to the cloud

http://www.arqbackup.com

hemancusoon Show HN: Zero – Local file system transparently swapping to the cloud

Very cool project! Close to my heart. I write ExpanDrive

http://www.expandrive.com

Which operates with the same idea, up to a 10Gb local cache and will stream out larger files. Supports a huge number of storage back ends (Dropbox, Google Drive/GCS, Amazon S3/Drive, OneDrive, SFTP, etc). Also can pin files and trees into the cache.

hemancusoon Design Thinking: B2 APIs and the Hidden Costs of S3 Compatibility

What special hardware vs a few cores with a reverse proxy? Surely a trivial cost.

hemancusoon Design Thinking: B2 APIs and the Hidden Costs of S3 Compatibility

It’s a bit unclear to me what is so expensive about the load balancing nodes. Care that explain why it’s substantially more than a few round robin’d smart reverse proxies moving data to the correct storage node? With S3/Dynamo design the back end destination is largely known from the hash ring.

Also- Wasabi has fantastic pricing and full s3 compatibility.

hemancusoon Landlord: Per-Tenant Stats in Postgres with Citus

Mostly an easy and performant HA story that can scale to a huge number of queries per second for an app that is largely CRUD and vanilla webapp saas queries. Cockroach seems perfect but the performance seems pretty scary in certain scenarios.

Being able to just drop the DB into a k8s cluster and not worry too much about failover gotchas and leader election has a lot of value. As does being able to throw more nodes on for more performance. Complicated OLAP queries aren't in scope.

hemancusoon Landlord: Per-Tenant Stats in Postgres with Citus

Thanks! Did you consider any other options?

hemancusoon Landlord: Per-Tenant Stats in Postgres with Citus

Can you say anything to help understand the differences between cockroach and Citus?

hemancusoon Landlord: Per-Tenant Stats in Postgres with Citus

Yes but they both target horizontial scale out and OLTP is a target for both.

And yes, cockroach isn’t Postgres but it has SQL, versus something like Mongo or Cassandra.

hemancusoon Landlord: Per-Tenant Stats in Postgres with Citus

I’d love to know if anyone here has done a deep eval of Citus vs CockroachDB. They seem to be the two most promising solutions for horizontal scale-out Postgres and both are under very active development.

hemancusoon Show HN: Google Drive as a file system

In beta!

hemancusoon Show HN: Google Drive as a file system

Very cool!

I ship a similar product that has included Google Drive integration (and many other back ends) since 2013 - https://www.expandrive.com - happy to answer any questions too!

hemancusoon Announcing Linode Block Storage Volumes

They have been offering it since June, FWIW. And it is worth knowing the order of magnitude of expected failure rates compared to just running against the local SSD.

hemancusoon Announcing Linode Block Storage Volumes

I wish these block storage services gave you some idea of failure rate/durability and availability. Amazon publishes some rough volume loss rates but not even Google tells you what kind of durability to expect out of a persistent volume. They all say they are tri-replicated, which semi-implies highly durable storage. What about availability?

Lastly, I'd love to know if DO/Linode have custom rolled their solution or are using Ceph or something similar. Not that I don't trust them, but they aren't recruiting the same engineers as Google.

hemancusoon Tesla ‘on Autopilot’ slams into parked fire truck on freeway

Couldn’t agree more. People who argue for Elon’s meaning of auto-pilot are wrong. Unless 100% of Tesla drivers are 100% aware of the limitations calling it auto-pilot is dangerous.

hemancusoon Richest 1% took 82% of new global wealth last year, report says

Capital appreciates faster than labor, and last year capital appreciated dramatically. The richest 1% have most of the investable capital. No surprise here?

hemancusoon iOS 11 Security [pdf]

I think Apple employs engineers and leadership who care about privacy and security and are willing to marshall the resources to bring that about. I doubt too many customers really truly care.

hemancusoon How Discord Resizes 150M Images Every Day with Go and C++

I'd love to be pointed at any resource where somebody who has spent the time walks through the best way to do this safely. Is the only way to do it safely inside a container via some networked connection? Are there other ways to lock down ImageMagick etc such that you can resize safely?

hemancusoon Google's CEO is increasingly boxed in by regulators, critics, and employees

51% of the voting shares

hemancusoon Polhems Prize awarded to Daniel Stenberg for the creation of cURL

I write ExpanDrive and when we moved from Python->C++ I used Microsoft's https://github.com/Microsoft/cpprestsdk C++ REST SDK [Casablanca], because it is Microsoft, documented, modern, nice C++ etc.

But for the latest iteration we switched everything over to libcurl. Libcurl has a bazillion edge cases handled. There are a million options, and it supports EVERYTHING. It has cross-platform functionality nailed. Daniel has been developing it forever and continues to do so. The code is obvious and procedural. A great project. Not the friendliest API, but it's 100% predictable and it WORKS.

hemancusoon Zika virus used to treat aggressive brain cancer in mice

I'd love for somebody to explain how you get a group of brain tumor-bearing mice. Can one somehow prompt glioblastoma to occur in some meaningful percentage of mice? I scanned the paper but found nothing.

hemancusoon Rclone banned from Amazon Drive for having the encrypted secrets in code

They just updated it to a new/improved version of the API

hemancusoon Ask HN: Google Doc email virus?

This was particularly effective because the app was registered as "Google Docs" - to not even filter names of your own products out seems ripe picking for imposter apps.