Hacker News Reader

Define big data? Have you tried https://github.com/kahing/goofys/ ?

Disclaimer: I am the author

Yes. 1PB. Although I don't remember the specifics about reliability; something about having to remount the entire fs if it wasn't 100% there.

What do you mean by not 100% there?

depends how you would use it i guess. And it seems quite bound to certain data formats.

I initially thought after reading the headline, data as in any kinds of bytes to replicate or something. But it is something else, mainly by reading "is focused on optimized transport of the Arrow columnar format (i.e. “Arrow record batches”) over gRPC"

>> mounting solutions

Could you elaborate?