https://www.hetzner.com/dedicated-rootserver/dell/dx181/conf...
Basic configuration in Finland 1 224,91 €
1.92 TB SATA SSD Datacenter Edition 4 95,20 €
320,11 €
320 Euro equals 385.90 United States Dollar
First, we are getting better throughput from S3 than I we were using a SATA SSD. (and slower than a NVMe SSD). This is a bit of a secret.
Of course, single sequential throughput on S3 sucks. At the end of the day the data is stored on spining disk and we cannot do anything against the law physics.
... but we can concurrently read many disks using s3. Network is our only bottleneck. The theoretical upper bound on our instances is 2GB/s. On throughput intensive 1s query, we observe an average of 1GB/s.
Also you are not accounting for replication. S3 costs include battle tested, multi-DC replication.
Last but not least, S3 trivially decouples compute and storage. It means that we can host 100 different indices on S3, and use the same pool of search server to deal with the CPU-bound stuff.
This last bit is really what drives the price an extra 5x down for many use case.
Sometimes we pay a bit too much for this multi-replication, battle tested stuff. It's not like the probability of loosing data is THAT huge. For the 4x extra cost you could easily take a backup every 24h.
"It means that we can host 100 different indices on S3, and use the same pool of search server to deal with the CPU-bound stuff"
You can do that with NFS.
It's amazing how much we are willing to pay for a bunch of computers in the cloud. Leasing a new car costs around $350/month. You could have three new cars at your disposal for the same price as this search implementation.
It's also worth considering the cost to simply regenerate the data for something like this that isn't the source of truth. You'll lose any content that you indexed that has disappeared from the web, but that seems like a feature more than a bug.
> You can do that with NFS.
You're going to be bound by your NIC speed. You can bond them together, but the upper bounds on NFS performance are going to be significantly lower than on S3. Whether that's going to be an issue for them or not, I don't know, but a big part of the reason for separating compute and storage is so that one of them can scale massively without the other.
There’s the extra burden of managing the minio servers.
Once they available again
Bought it 2 weeks ago for 60/month.
Or are you referencing something like CPU shortage at that model?
Can you get anywhere close to this with AWS or even DO?
Go to the AWS console and try to answer even simply things like how much did the last hour/day/week cost me? Or how about some notifications if that new service you just added is going to cost vastly more than you where expecting.
I know of a few people getting fired after migrating to AWS and it’s not because the company was suddenly saving money.
>Go to the AWS console and try to answer even simply things like how much did the last hour/day/week cost me?
Click user@account in top right, click My Billing Dashboard, spend this month is on that page in giant font, click Cost Explorer for more granular breakdown (day, service, etc.), click Bill Details for list breakdown of spend by month.
>Or how about some notifications if that new service you just added is going to cost vastly more than you where expecting.
Billing Dashboard and then Budgets.
edit: This assumes you have permissions to see billing details, by default non-root accounts do not which might be why you're confused.
Sure, you see a number but I was just talking with someone at AWS who said it you still can’t trust it to be up to date especially across zone boundaries. That means it’s useful when everything is working as expected but can be actively misleading when troubleshooting.
I've never seen AWS actively try to trick people into spending more money. I've seen Premium Support, product service teams, solutions architects, and account managers all suggest not to use AWS services if it doesn't fit the customer usecase. I've personally recommended non-AWS options for customers who are trying to fit a square peg into a round hole.
Can the billing console be better? Yes. But AWS isn't trying to trick anyone into anything. The console, while it has its troubles, doesn't have dark patterns and pricing is transparent. You pay for what you use, and prices have never decreased.
Hell, I know of a specific service that was priced poorly (meaning it wasn't profitable for AWS). Instead of raising prices, AWS ate its hat while rewriting the entire service from scratch to give it better offerings and make it cheaper (both for AWS and customers).
Other stuff was more debatable, but it just felt like dancing in a mine field.
You read "you can run Lambda in VPC", great, but there is a fine print somewhere on a remote page, that you'd also need NAT gateway if you want said Lambda to access internet, public network wont do.
You read "you can enable SSE on S3", but it is not immediately obvious, that every request then incurs KMS call and billed accordingly (that was before bucket key feture).
Want to enable Control Tower? It creates so many services, it is impossible to predict costs until you enable it and wait to be billed.
If pricing is intended to be transparent, then why is it completely absent from the user interface? Transparent pricing would be to tell me how much something costs when I order it, not make me use a different tool or find it in the documentation
If clarity causes customers to spend less it is disincentivized and since clarity is hard and requires active investment to maintain it decays naturally.
It's easy to see how you can end up with a system that the users experience as a dishonest attempt to get more of their money and operators, who are necessarily very familiar with the system experience as merely messy but transparent.
Neither is precisely wrong however your users don't have your experience or training and many are liable to interact with a computer not you. Your system is then exactly as honest and transparent as your UI as perceived by your average user.
Ordering a server at Hetzner can take anywhere between a few minutes and a few days. Each server has a fixed setup cost of around the monthly rent. They only have two datacenters in Europe. They don't have any auxillary services (databases, queues, scalable object storage, etc.). They are unbeatable for certain use-cases, but the cloud is still valuable for lots of other scenarios.
Nonsense, Hetzner operates like 25 datacenters.
At the start of the pandemic, ordering bare metal servers anywhere was faster than getting a new EC2 VM up and running...
The cloud doesn't even fulfil the value proposition of the cloud. It's significantly more expensive, and when you actually need the flexibility, none of it is available.
Similar with DO, the closest equivalent is a 3.52GB SSD, 128GB RAM, 16 vCPU droplet for $1240/month.
If you need raw power instead of integration into an extensive service ecosystem, dedicated servers are hard to beat (short of colocating your own hardware, which comes with more headache). And Hetzner is among the best in terms of value/money.
afaik their most popular product is the EX4x line with a i7-6700.
I had a hetzner server for years and now again.
Normal consumer hardware without any magic for very good prices.
I made even 10tb traffic and run Rosetta 24/7 for 2 years without any issues.
Just expect downtime if that's your only server and it breaks.
The last few years it got really crazy what you get for 50bucks a month.
Shared nothing is the best architecture for e-commerce search for instance.
But if you have one query every minutes or so for a 1TB dataset, it feels a bit silly to have a couple of servers dedicated to it doesn't it? Imagine this is the case for all big data search you can think of... Logs, emails, etc. This is a waste of CPU and RAM.
Assuming you don't want to do a hybrid approach, then you either push everyone onto the cloud and accept paying more, or you push everyone into colo and force the small and scaling out projects to deal with stuff like having to order hardware 3 months in advance.
Then, depending on how nice you want it to be to interact with your infrastructure, you can end up paying a lot to have people build abstractions over it. Do you want developers to be able to create their own database from a merge request or API call? If so, now you're going to have to hire someone with a 6 figure salary to figure out how to do that. It's easy to forget how many things are involved in that. You're going to have a lot of databases, so you need a system to track them. A lot of these databases are presumably not big enough to warrant a full physical server, so you have to sort out multi-tenancy. If you have multi-tenancy, you need a way to handle RBAC so one user can't bork all the databases on the host. You will also need some way to handle what happens when one user is throwing so much load at the RDBMS it's impacting other apps on that database. To accomplish that, you're going to need a way to gather metrics that are sharded per-database and a way to monitor those (which is admittedly one of the easier bits). You also generally just straight up lose a lot of the scaling features. I don't have a way to just give you more IOPS to your database on-prem. The best I can do is add more disks, but your database will be down for a long time if I have to put a disk in, expand the RAID, let it redistribute data and then power it back up. That's several hours of downtime for you, along with anyone who's on the same database. Of course, we can do replicas, and swap the master, but everyone will have to reconfigure their apps or we need something like Consul to handle that (which means more engineers to manage that stuff).
You're also probably going to need more than one of those expensive infra people, because they presumably need an on-call rotation, and no one is going to agree to be on-call the time. And every time someone quits, you have to train the new person, which is several months of salary basically wasted.
That's not to say that you don't need infra people on AWS, but you a) need a lot less of them, because they only need to manage the systems AWS has, not build them, and b) you can hire cheaper ops people, again because you don't need people that are capable of building those kinds of systems.
Once you factor in all of that stuff, AWS' prices start looking more reasonable. They're still a little higher, but they're not double the price. If anything more than a tiny, tiny subset of the AWS features are appealing, it's going to cost you almost as much to build your own as it does to just pay Amazon/Google/Microsoft/whoever.
Also, a massive thing people overlook is that AWS is fairly well documented. I can Google exactly how to set up permissions on an S3 bucket, or how to use an S3 bucket as a website. It only takes seconds, the cognitive burden is low, and the low-friction doesn't cause anyone stress. In-house systems tend to be poorly documented, and doing anything slightly outside the norm becomes a "set up a meeting with the infra team" kind of thing. It takes forever, but more importantly, it takes a lot of thought and it's frustrating.
What used to be an apache serving static files, now is S3 bucket, but it wont be easy, because you wanted your own domain, so now you need a Cloudfront because of SSL support. Their tutorial conveniently mentions it only at the step 7 ("Test your website endpoint").
You buy into Cognito, great, saved money on Keycloak administrator, but in the worst moment deep in the project you learn that there is absolutely no way to support multiple regions, even if you are willing to do some leg work for AWS. Or find that Cognito email reset flow can't go through your existing customer contact system and must go through SES only, suddenly you find developing elaborate log/event processing tool just that your customer service agent can see password reset event on their interface.
GCP CloudSQL, managed RDBMS, great! No upgrade for you other than SQL dump/restore your 10TB instance, have fun.
Cloud might be a net win still, but it is very much not as rosy as cloud evangelists want us think.
That well defined setup with load balancer, multiple VMS, snapshotting as backup, von/ipsec and vlan was something I couldn't have build and maintained by myself and doing other things 15 years ago without cloud.
The worst is that a lot of "specialized" people are actually not experts at all. They are just there as support person's.
From 3 DB admins one was really good and the other 2 sucked (other company again). The one you never saw comes to you, starts thing on an oracle shell basically blind and does complex things and the other two you tell them what they forgot.
As an admin your job is seldomly to optimize queries etc. But more adding and removing users, configuring backups, playing back backups, upgrading etc.
At least for me it opened up what I can do as a single expert and faster and in better quality.
I would highly recommend normal companies who think they are not an it company (everyone is one today) to run in the cloud only.
> In-house systems tend to be poorly documented, and doing anything slightly outside the norm becomes a "set up a meeting with the infra team" kind of thing.
I usually wasn’t really happy with AWS’ documentation. But now, considering the alternative, it find it quite lovely. Thank you for making me realize that.
Otoh, the bare metal hoster I worked with is now owned by IBM, and a big competitor is owned by private equity; bare metal from cloud providers still has a lot of cloudiness associated too. Maybe colo is the way to go.
I'd be curious to see any reports about their fire response in their recent incident as well as any changes they made or didn't make to other sites.
A few grant infrastructure cost for any modern company is nothing and an outage costs you much more.
You can also bet that proper backup is either missing or was paid for expensive enough.
On Aws you activate snapshots and that's it.
https://www.hetzner.com/rechtliches/cloud-server/?country=de
i know a couple people have naughty stuff on it (like sex toy shops, sexual services, private for sale adult videos)
do you know if Amazon S3 allows adult content?