Comment by antongribok | Hacker News Reader

Comment by antongribok | Hacker News Reader

Laptops:

   LG Gram 17" 16GB RAM and dual NVMe disks - Fedora, main machine for work
   Dell XPS 13 - Fedora, wife's laptop
   Mac Book Pro 16" 2019 - Official work laptop, used as a paperweight
   Toshiba Tecra 740CDT - Recently revived, Knoppix (kind of retro playground)

Desktops:

   Ryzen 2700X w 64GB RAM 6-disk ZFS - Fedora, backup storage, video transcoding, photo editing
   Xeon E3-1230 w 16GB RAM - OPNsense, house firewall

NAS:

   9x Raspberry Pi 4s, (mix of 8 and 4 GB RAM) - Ubuntu 20.04 with Ceph Pacific used as main network storage with CephFS

How is ceph on the RPIs?

Given the single GigE network and SMR drives, it's not very fast, but fast enough for my needs.

More importantly, it is more reliable than running ZFS on a single box, which is what this Ceph cluster is replacing. I've had 100% uptime for 11 months, and I've been able to move the PIs physically around my house in this time.

Also, the power utilization is lower which is actually very impressive. I'm using 2.5" SMR drives, so that helps.

Most of my data is on an erasure-coded pool with a 4+2 setup, and the PIs are fast enough. CephFS has been very reliable on the laptops as clients, and reconnects within 1 second after sleep.

I'm also using compression, and it's not a problem on the PIs.

Reply on news.ycombinator.com