Or maybe I'm just too chicken with modifying actual physical objects.
Or maybe I'm just too chicken with modifying actual physical objects.
Hardware wise it's:
- Asrock Rack C246 WSI Mini ITX motherboard - 32GB ECC RAM (2x 16GB UDIMMS) - benefit of using the C246 chipset - Intel i3-9100T - 6 IronWolf 4TB NAS drives - 2U Short Depth rackmount chassis (so it fits in my network rack) - 1TB Samsung 850 Evo boot drive
Idles at 23W which is low enough for my tastes, ramps up to 65W under load (I spin the disks down after 10 minutes of inactivity, even doing that I'm only seeing about 10k load/unload cycles a year (drive is rated for 600k).
Who do I have to kill to get one :)
They're just bog standard x86 boxes with a lot of drive slots, a backplane, and a lot of sad or sata ports and controller capacity. There's a pretty healthy used market in these things also. But they are targeting people who want to put 10 or more drives in a single enclosure, which is why I say they might not be consumer.
Honestly, best thing you can do now is just live with a tower server or buy off-lease from eBay. We've passed the hump where the off-lease eBay specials had the energy footprint of a small factory and used turbine jet engines to power the fans and cool things down.
I did buy once buy a no-name (ATX?) 2U case/rails only from eBay, but the manufacturing, accessibility, ergonomics, design, and everything else were terrible enough that I would not do it again.
Are there any good options today? I keep thinking of picking up a NAS, but I really do not want to use a proprietary vendor OS that might feel entitled to scan my data for useless/hostile cloud integrations. Or might have left some hardcoded password backdoors.
https://nas.ugreen.com/pages/ugreen-nas-storage-preheat
Their hardware is dramatically better at the price points then the alternatives - even if they do have some comprimises.
The only thing I really miss here is ECC ram, but that's entirely due to Intel's market segmentation and not something they can change, save by completely changing their platform vendor.
[0] https://aoostar.com/products/aoostar-r1-2bay-nas-intel-n100-...
Intel Alder Lake N100, $189, https://aoostar.com/products/aoostar-r1-2bay-nas-intel-n100-...
Ryzen 5700, $299, https://aoostar.com/products/aoostar-r7-2-bay-nas-amd-ryzen-...
You could buy an old HP Proliant server (gen8?) and plug in 4 x 16TB HDDs and boot from the 5th drive.
A regular PC will work fine if this is what you want to do. A lot of consumer motherboards these days have at least 2 x NVMe and 6 x SATA ports or more. There are rack-mount cases that allow you to front-mount the SATA hard drives to make it easy to swap them.
Or if you want something small, you can get a compact Mini-ITX case with 5.25" drive bays and put hotswap trays in them.
Like maybe this case https://www.bhphotovideo.com/c/product/1193826-REG/istarusa_...
And put one of these for 4 x 2.5" SSDs: https://www.amazon.com/gp/product/B00V5JHOXQ/
And one of these for USB/SD card reader galore: https://www.amazon.com/EZDIY-FAB-Internal-Reader-Support-Com...
The reason I often do NOT want a vanilla OS is that I don't want to have to maintain it or risk corruption of the OS partition, and don't want to ever have to wire up a keyboard, mouse, and monitor because some upgrade and reboot caused it to get stuck on some interactive prompt. Most commercial NAS (e.g. Synology) have web-based administration and read-only partitions for the OS fully figured out.
2tb nvme cache + 20TB a drive + parity is 140 useable TB, and unraid makes the NAS stuff really easy, just installed a bunch of "apps" which are basically docker containers + settings, and things are a breeze.
I'm moving towards used, ancient, large desktop cases. You can find them at computer recyleries if you have them in your area or local marketplaces. I got one with a hotswap backplane and trays and everything in the 5.25" bays. Of course, the backplane didn't work for me, so I had to pull out the backplane and just wire the drives like normal, but trays are still nice.
I've got lots of space, so I just leave a keyboard and monitor next to my servers, in case I break something. It's not elegant, but it's cost effective. A used $10 monitor and a keyboard I don't like will last forever, but buying boards with IPMI adds $100-$200 everytime I upgrade.
When you move you can also just move it all in one piece if you have a liftgate van.
And you have an easier upgrade path. If you buy one pair of ~40 TB drives in a couple of years, you can replace one of the mirrors just by swapping out the old disks one by one and waiting for resilver. Then ZFS can autoexpand your storage to 18 + 40 TB total. And you can repeat further down the line, going 40 + 80 TB or whatever is available, true Ship of Theseus style.
Yes, you lose a little resilience compared to RAIDZ2, but RAID is just a HA solution, not a backup solution, no matter how fancy you make it. And a RAIDZ2 gradual-upgrade by replacing disk after disk is just horrible.
Then another 2x18TB for backup.
What I do for my personal setup is RAID + nightly backup (3 drives total) in one machine, and then a 4th hard drive that normally lives airgapped in a rental storage unit that I bring home and sync every 6 months or so.
The nightly backup serves to always fetch yesterday's version of any file, and deals with 99% of scenarios that I'd need a real backup.
The 1% (hackers + fires/disasters) is taken care of by the storage unit but I lose the last 6 months of changes.
Personally, I like 6x SATA for a couple reasons. One is my case has sleds for 6 drives :P. The other is I run two servers with 2x mirrors as the main storage (they backup each other and are in different buildings although on the same site, which gives me a little redundancy, but not much); I've done an upgrade once from 4 tb to 10 tb, so my case with 6 sleds now has the main 10tb mirror array, and a playspace for less important stuff that I can figure out how to use over time; currently I've got it split up between 50% of each disk used individually for tv recordings, and the other 50% as a raidz2 to hold dvd's i've ripped and fanedits.
When I upgrade/replace the main mirrors, I may update the other server to have more slots, and then it can have a 4x 10tb playspace.
> Yes, you lose a little resilience compared to RAIDZ2, but RAID is just a HA solution, not a backup solution, no matter how fancy you make it. And a RAIDZ2 gradual-upgrade by replacing disk after disk is just horrible.
I haven't done it, so I'm not disagreeing... I'm assuming the main objection is it takes a long time, and the secondary objection is the system has a lot of disk contention while it's in progress. I'd probably address the takes a long time by just planning to do one disk every other week. That means it's a two month process, but it also means that the drives in the system have a two month offset on usage time; a lot of drive array failures are due to correlated failures, and offsetting the power on time can help. If all of your disks are likely to fail when their power on counter rolls over, it's nice if you have two weeks between failures --- that should hopefully be plenty of time to replace disks before you lose the data.
Ordering disks over a two month period may also help avoid getting all disks from the same batch; but sometimes it's better to order all at once for pricing, so that's mixed.
If you do have extra SATA ports, you might be able to do a replace while both the old and new disk are available... I'm not sure if that helps the process or not; it won't reduce the amount of writes to the new drive, but maybe it helps with disk contention during the process?
0: https://www.ebay.com/itm/256268302567
(no relation with the seller, just found searching "6xsata m.2" and removing those with lower feedback ratings). There are also 5xsata similar cards.
0: https://www.reichelt.de/de/en/mobile-rack-3x-5-25-for-5x-3-5...
My current NAS is a mini PC connected to a external 8-bay USB3 enclosure with disks arranged as 4 ZFS mirror pools. It worked like charm with XigmaNAS (FreeBSD based) until the day I needed to add some files and the best solution was of course to connect another external USB disk to go faster than network transfer. As I connected the drive, suddenly all disks in the pools were shifted, with the external disk becoming part of the 1st pool, and all others mixed, with potentially devastating consequences. Of course I panicked and after a series of wrong moves destroyed the 1st pool which luckily I already had a very recent backup of. On BSD forums they explained that the embedded XigmaNAS edition does not make use of UUIDs so it's dependent on the order disks are being detected, which frankly shocked me: I wouldn't expect that from FreeBSD. Now, the detection order in case of the disk enclosure is always the same, but should I connect some other external drive, the disk order would go bonkers again, therefore I also feared what could happen if a disk suddenly becomes undetectable. However, it's only the web interface that goes out of sync wrt disk detection, and I later learned it can be fixed with the synchronize command. They say the full install is immune from that, and I plan to migrate everything, but I'd like to be sure I can do that transparently before embarking in that task.
[0] https://www.friendlyelec.com/index.php?route=product/product...
It’s an amazing project. I’m floored that it all works and that the author figured it out.
But still, I’ve never fully understood the appeal of using some of these custom design NAS products when a standard ATX computer is so much more customizable, modular, expandable, repairable, etc.
And many of these NAS systems are such a ripoff on pricing.
I don’t think desktop power consumption is all that bad if you’re careful about component selection.
Another alternative is to have one more performant system that runs a bunch of different things in virtual machines so that the NAS functionality is only a small part of the power consumption.
It for me was just a mater of how much time/effort did I want to sink into it. I just wanted a large storage system. A off the shelf NAS I can be up and running in 2-3 hours. For DIY there is the research time for parts (including the drives), cases, and which software to run (there are 3-4 decent choices). Then gluing it all together. Probably 2-3 days for me fiddling around with it and research time.
Take the one I went with synology. The one I picked was in the 600 dollar range for the case. By the time your done picking a decently powered board, case and memory and cpu. You are in the same ballpark of cost for similar perf. The package was all done. I did not have to do much (notice a theme?). My most expensive part of the build? The drives themselves.
The downside is now I want something like 2.5g (or better) and the particular one I picked has zero way to upgrade (other than ripping the thing apart and hoping the right drivers are in there). It is about trade offs. Did I really want the possibility of upgrade or up and running quickly. Remember this is not something I do all the time. It is something I do every 3-4 years so I have to refamiliarize myself with all the different possible parts. Plus getting the OS in there 'just right'. Not impossible or even hard. I just chose a different trade off.
You can get a truenas but its a little under powered for what it is especially if you want to use it not as a nas. This is the tradeoff for buying a turnkey product in a niche market.
That being said you can just build your own nas. There are nas boards with multiple sata already built in for you as well as cases designed for these sorts of boards and multiple hdds. jonesbo cases are popular for this. at a certain point though it stops making sense to build one of these and starts making sense to rack mount your storage array, of which the options are far more numerous.