PiBox Mini – Modular Raspberry Pi Storage Server
pibox.io
pibox.io
In this case, the PiBox is being offered by KubeSail[1], a company which specializes in services like tunneling (they're already on the list mentioned above). It will be very interesting to see if they can bundle it in such a way that people don't have to worry about how the tunneling works. Extra points if they make it easy for users to buy/use their own domains.
but a couple boxes also ssh into a vps, and forward their own ssh ports to the vps, so i can jump into them indirectly if the main door/direct ssh way isnt working. this is also an ok way to expose ports on the internet if i want them proxied, if i need rate limiting.
even if i go to a friends house with a system, it should have a good chance of configuring itself there too. that's one huge advantage. mostly though i just dont want the centealization, dont want to be thinking about configuring routers.
Then I just altered the IP on connection. It actually changed very rarely but until I learned of better ways, I liked it.
That's the vision anyways!
I’d love it if they focussed on improving the UI and sharing aspects rather than pushing their media and weird default requirement for internet access.
I’d happily pay more for the path I want.
I looked into Tailscale because the hype is big, and I’m sure it’s good software… but the biggest reason I pay for a VPS is to get public IPv4 addresses I can connect to. A proxy will only add overhead and compromise privacy.
Edit: specifically, Tailscale uses their own proprietary relay servers, and if you don’t want to use them you can’t use tailscale. ¯\_(ツ)_/¯
This is incorrect [0]. You can use your own relay servers [0].
However, Tailscale only uses the relay servers as a last resort. Most of the time, the connection will be established directly between the peers.
If you're able to configure port forwarding on your router as another commenter said, wireguard works well enough. You'll probably be able to also set up some form of dynamic DNS if you don't have a static IP (like no-ip or duckdns, etc). In this case, you don't need Tailscale.
However, there are more and more people who aren't able to do the port-forwarding thing any more, such as those behind CG-NAT. For example, in France and, from what I hear, the UK, this seems to spread. In these cases, Tailscale's NAT traversal techniques may still work – that is, your connection will be directly between your two peers and not through their relays.
Also, of note is that their relays are open source [1], and you can run your own. But if that's the case, you probably don't need Tailscale and can get away with some kind of hub-and-spoke setup.
---
Currently I run a server on a digital ocean box I access via a custom domain with a let's encrypt cert (too much detail about this setup is here: https://zalberico.com/essay/2020/06/06/urbit-on-the-cloud.ht...). It'd be cool to have this run on my home Mac Mini and just access it from the web.
What is actually going on to require this? I still need the custom domain, but now that custom domain is routing somewhere else right? Either to some software that's still running on digital ocean that handles this (wireguard?) that I'd have to configure or some service that deals with this? What are the actual pieces that are required for this to work and if you wanted to do it and control it yourself what do you need to know to do it safely?
Any pointers in the right direction/high level explanation would be helpful - there are a lot of unknown unknowns when searching or just services you pay for that abstract it away with some tradeoff in control (at which point I might as well just leave it on digital ocean).
Thanks!
If my understanding is correct, you want this server to be publicly accessible, i.e. by anyone, not just you or a limited, well-defined set of people. If that's the case, you don't need Tailscale, which can be seen more like a VPN.
If you don't have CG-NAT (meaning your home router gets a public, routable IP) you can probably set up port forwarding to your Mac and some script that would update your DNS entry if your IP isn't static.
If you DO have CG-NAT, or for some other reason you cannot forward any ports, you'll have to use something external to at least route the traffic. I've glossed over your link, so this may not work, but you could look at proxying your traffic with Cloudflare. Look up cloudflared. If that doesn't work, then yes, something like wireguard between your DO VM and your home Mac could work.
All in all, I think this is more or less a classic "home server" setup, so you should be searching for "hosting a server at home" or similar.
What I did was:
1. Install Tailscale on my devices (server, laptop, phone, etc.)
2. Setup a cert with LetsEncrypt and import it into Apache. I use AWS Route53, so this was as easy as setting up my AWS credentials and running the certbot cli.
3. Setup a A & AAAA record pointing to my server's Tailscale IPv4 and IPv6 addresses. This is fine even though these addresses are only accessible through Tailscale. You'll obviously still need to be connected to Tailscale, but you can just use your custom domain name to connect.
4. Done!
I use this server for media streaming and file syncing. I manage it with Ansible; I've even have GitHub Actions set up to run my Ansible playbook whenever I commit!
https://github.com/shepherdjerred/ansible-playbook/blob/mast...
It’s some black magic.
The “magic” is just that it’s all automatic works pretty much no matter what.
"Finally, a NAS that lets you use a standard operating system that you’re used to, like Ubuntu or Raspberry Pi OS."
However I wouldn't let the random vendor webstack with cloud sync anywhere near anything I care about.
There are exceptions of course, but it's not an easy task to find a nice solution that is quiet, vibration damped (easier on spinning disks), good airflow (keep drives cool), nice mini-itx or similar motherboard (ideally with ECC), an expansion port (10G or M.2/U2 cache), etc.
One I've had my eye on is the Fractal Design Node 304.
I own Synology NASs, but adding an expander for that is expensive. (AUD$800)
The ODroid-HC4 looks promising, but their 'toaster' case design for it is awful, leaving the drives exposed and unable to put two atop each other.
Ideally what I'd like is:
- 1-2x 3.5" SATA drives
- Gbit NIC
- Enough grunt to run some kind of clustered filesystem (gluster, ceph, whatever)
The idea being that I could start a cluster with say 3x of these devices, and then as my storage needs grow - add more.
They don't need to have stellar IO, but enough to keep up with plex.
I also have a rockpro64 with two 8tb WD red pro and in subvolumes with encryption i only get 70MB and in non encrypted 110MB. I already switched from aes256-gcm (the default) to aes256-ccm, since that is less taxing ob the CPU.
I Start to get the feeling that zfs arm is not yet optimised enough.
shows me ~400-500 MiB/s (per core) for aes-xts-256 on slower rk3566
I guess it will be similar for gcm
[0] OK, I get that these guys want to gauge interest as precisely as possible, given the frightening prospect of being a hardware startup during a chip shortage and/or burgeoning logistics apocalypse, but it's still a real eye-roller. Especially given how, like, cool this project otherwise seems.
[1] https://pibox.io/prefs <- note that without having already signed up, this'll bounce you to the homepage
It's pretty clear (to me, at least) that they're trying to see what people want (and even helpfully give the expected price points for the various options) in order to decide what order to design and build things, and I'm more than happy to help give that information, as well as give them my email address so they can tell me when the thing I want is going to be available.
I guess I just don't see what your objection is to their flow. The only improvement I could see would be waiting to ask for an email address until the end instead of the beginning, but I don't see that as being all that huge. And honestly I see that as sorta worse: it feels dark-patterny to get people to engage with you (in this case, by putting the various hardware option selections first), and then after they've invested the time, require an email address to make that time worthwhile.
...they're asking for my email in order to let me see the prices. Why do they need my email in order to let me see the prices? Answer: they don't. So, uh, why are they asking for it? I find this bonkers. There are all kinds of Hackers on this site; I consider myself a Computer subtype, but I suppose from the perspective of the Growth Hacker, this isn't strange at all.
>And honestly I see that as sorta worse: it feels dark-patterny to get people to engage with you (in this case, by putting the various hardware option selections first), and then after they've invested the time, require an email address to make that time worthwhile
Question, would you engage in business with a physical store that made you provide ID (or even just an email) before letting you see how much things cost? Personally I go to the liquor store, select some liquor based on price and whimsy, and then I show them my ID to complete the flow. Placing roadblocks in the path of that flow -- I can't see the price without ID, and I can't just whimsically browse the shelves if I have to signal my intent to be there by digging out my ID before I enter -- seems like a bad idea.
I see a Synology 5-bay NAS on Amazon for around $700. The PiBox 5 plus an 8GB CM4 w/32GB eMMC runs less than $350. Even though I'd expect the performance of the PiBox to be less than that of a Synology NAS, I will gladly pay half price for something decent that runs an OS that I can update essentially forever and manage how I see fit.
[0] Luckily I've managed to build and flash a modern kernel and install Debian buster on it, since support for its hardware has been upstreamed, but I imagine this is the exception, not the rule.
That being said, I love that someone is working on making this stuff easier to do, it was finicky to get it setup myself. I would be backing it if I hadn't just done it already.
I wish Kubesail all the best and I hope they succeed.
My main concern is that when it comes to self-hosting photos and videos, that's against the TOS for Cloudflare's free tier. If enough people start using it I assume they'll crack down. Bandwidth isn't free.
But I am also not sure why I'd want to expose my photos and videos to the internet. Just use a VPN of some sort.
In any case, the MITM issue you mention is no different of a risk profile than storing your data on google drive or icloud, which is what most people are currently doing. Hosting through Cloudflare on a domain you own isn't perfect, but it's a big step in the right direction.
> But I am also not sure why I'd want to expose my photos and videos to the internet
I often share photos and videos with others, whether actually allowing them access directly through their device, or pulling images up on my phone to show them in person.
The CM4 draws somewhere between 7 and 9 watts under peak load, and each SSD would be around 2W under load. That feels pretty tight already.
I'm sure it would be totally fine at idle and low loads, but I just can't see it being enough juice at full load with two drives, especially if there are other services running on it and the storage is encrypted.
Happy to answer any questions!
With a little more polish I could see myself recommending it to more people, especially in tandem with units like the PiBox.
Will it be easy for users to bring their own domain and/or buy one through you, or will they have to use a domain you control to use KubeSail tunneling?
[0] https://news.ycombinator.com/item?id=28993970
[2] https://www.kickstarter.com/projects/pastudan/pibox-a-modula...
Has anyone managed to properly replace google photos with a self-hosted solution? It should:
1. have first class Android and Ios apps
2. should have auto-upload from mobile apps
3. should have share functionality between users, so I can share with my family
4. have a nice web/native app that lets me browse and manage pics on a computer
I understand that it is tough for open-source/free projects to build and maintain mobile apps (due to store fees etc). However, I think this is a big problem and I'm ready to pay for such software. Just not a subscription like google photos.
On the other hand, you can have a USB3.1 hard drive docking station(around $30 for 2 hard drives) to hook into any cheap SBC board that provides a USB3 port. another way to do poorman NAS.
If you can make this use some PCI path to the drives, and support 2.5" laptops or SSDs, then you're on the same journey to a better story.
Radaxa have a vertical chassis, with a fan. It runs the fan a LOT. I suspect driving disks is hot work.
I have a bunch of 4 TB externals that I would love to put to use. I know Synology, etc. exist but I don't need something so heavy. Just a simple Pi based case that can take one or two disks would be awesome.
Was really looking forward to the Helios 64 but unfortunately, they closed shop: https://kobol.io/
I'm looking for a simple DAS/NAS for 5-10 2.5" SSDs to attach either via a couple of 1gbit links, usb 3.(0/1) of a SAS connector (that could connect to a computer with a SAS/SATA controller running in HBA/JBOD mode.) but there doesn't seem to be much out there in the 2.5" space.
$250 PiBox Carrier and Daughter Boards Powder Coated Steel Case Noctua 5v PWM Fan External WiFi Antenna 1.3" LCD Display 15W USB-C Wall Adapter
Raspberry Pi CM4 - 8GB RAM / 8GB eMMC / WiFi model - Pre-flashed with PiBox OS for easy setup
$450 Everything above but with SSD drives installed. Ready to be plugged in and used in seconds.
- Includes 2 x Crucial MX500 1TB SSD Drives
Primary the value for me in storing my 260.000 (approximate actual number) somewhere online is the reliability it gives. So far with the services I use I have had 0 data loss.
I also have my photos stored in my home but now I do not have to worry about losing precious data if the storage dies. (apart from restoring / syncing from the cloud can take a very loooooong time, and depending on service might also cost a lot from bsndwith usage)
Doing local backups is prudent, if a bit complicated if your storage is in the 10TB - 200TB range. Ten rotate keep at least one off site.
I wish I could afford some of the new streamers, they can fit a lot of data into a small space.
I hope this can replace my own poor man's Pi4 NAS which has USB storage attached.
Currently on the hunt for a short-depth (<500mm) 19" drive shelf with at least 16 3.5" slots.
I’m currently using an old HP microserver (4 x 3.5”), but outgrowing it a bit…
My dream is a CM4 board with 2xM2 slots for RAID1 boot drive, and 5+ SATA ports for 3.5” HDDs
[1] https://pipci.jeffgeerling.com/cards_network/rosewill-rc2000...
I hope they make the 3.5" model too, though—it would be more cost effective (and fit the Pi's performance better) to use 3.5" HDDs that are a lot cheaper per GB, and could still easily saturate the 1 Gbps network jack.
Sure, it’s not running an OS flavored for the Pi, but everything else you want is covered.
If you really need the sustained performance, especially if you want to use it for things like transcoding, it's better to get more supported hardware.
https://www.qnap.com/en-us/product/ts-932px
5 HDDs and 4 SSDs for caching, with 10gbit fiber or 2.5gbit ethernet.
I have 40 terabytes of storage in mine(21TB free). If I ever fill it up, I'll probably buy an actual storage server with ~500TB of drives.
But, the data is more important than the OS here. And the filesystem is a variant of ext4 and there's some instructions floating around on how to mount drives on an external standard Linux machine to recover said data in the event of a disaster.
You should also back up the data regularly so it doesn't matter if the hardware or company fail.
I'd be find with a vendor linux, but vendors tend to get bored with older products, drop support, go bankrupt, get purchased, revoke previously promised functionality, have security holes in their addons, etc.
That's like asking how cooking is different from eating out. You do it yourself, you customize all the things, you're independent, it can be cheaper than managed services if you discount your time or even scale it only a little bit, and many people simply enjoy it.
And if something goes wrong, you know who's at fault, who's on call, and who's gonna fix it :D (I host my own mail server among other thing, and it's mostly unattended but still I felt I should nuance the comment a little bit.)
I feel I am more comfortable with saving my documents on respected cloud service.
I do have a NAS at home but its not open to the internet and I don't put my documents on it, just media files.