Hacker News Reader

We’ve seen horrendous performance on EFS unless you’ve provisioned quite a bit of storage on the volume.

Even if you have quite a bit of storage. ~40TB on EFS, and yet performance is abysmal due to the access time being about ~3ms.

So large files work well, but if you have many smaller files it's killer.

We built our app to do caching locally into NVMe drives though, so we async pull data from EFS and push back as necessary.

Definitely going to give Filestore a spin and see if it is a good fit for our use cases.

Underlying S3 bits do bite you when you deal with lots of small files. Our team even considered maintaining NFS or Gluster servers over horrible EFS performance.

Another file system that works well with lots of small files and that doesn't require maintaining any extra servers is ObjectiveFS[0]. It is a FUSE based log structured file system (with snapshots) using GCS or S3 for log storage with memory cache and (optional) disk cache for performance.

[0] https://objectivefs.com

Reply on news.ycombinator.com