https://jrs-s.net/2015/02/06/zfs-you-should-use-mirror-vdevs...
https://jrs-s.net/2015/02/06/zfs-you-should-use-mirror-vdevs...
Listed survival probability of N-disk failure in 8-drive/4-vdev mirror.
1: 1; 2: 0.857; 3: 0.667; 4: 0.400; 5: 0; 6: N/A; 7: N/A; 8: N/A
Proper survival probability:
1: 1; 2: 0.857; 3: 0.571; 4: 0.229; 5: 0; 6: 0; 7: 0; 8: 0
Comparatively, survival probability for 8-drive RAIDz4 with equal amount of usable space:
1: 1; 2: 1; 3: 1; 4: 1; 5: 0; 6: 0; 7: 0; 8: 0
Personally, I'd use multi-vdev mirror pools only for data that is either backed-up or data I can afford to lose completely.
You still need 6/Z2 if you want to have reasonable fault tolerance, unless you want to waste ungodly amount of space.
We did had a big case so we just ran 2xRAID6 setup and that one time where it was needed we just replaced to bigger drives one by one, while using the removed ones as spares for other machines. But that's benefit of scale bigger than "a NAS server".
I got 2 so I’ll also replace the sibling of the dead 4TB one.