Hetzner appears to impose unlisted “fair use” on traffic
lowendtalk.com
lowendtalk.com
That would be $16,691 worth of transfer from AWS (US East pricing for 250TB to the internet). I'm not arguing that AWS isn't overcharging, just putting up a comparison. Even at $0.01/GB, that would be $2,560.
They should probably just say 50TB with overages at $0.005/GB or something like that. They are offering 20TB on their cloud servers so 50TB on the dedicated seems reasonable and $0.005/GB for overages is less than you'll get almost anywhere else while still probably enough for Hetzner to make a profit.
You also can't set a max billing limit (or a soft limit).
It's not obvious that a script got caught in a loop and decided to write up a $5000 bill overnight.
Even so, I don't think it is AWS's fault that buggy code was left to run unattended overnight in the example you give.
It is absolutely 100% Amazon's decision to give you little to no tooling to prevent this in many scenarios other than going to their billing department and beg for a correction.
I do not use any service that can proceed to bankrupt me for personal use for what could be considered a normal use case. At work I'd pass the issue off to my manager who'd pass it off to a rep and deal with it that way, but there is no way I want to take that responsibility on myself to correct.
That aside, I also understand that they can't actually put a hard cap, since usage is measured after the fact occurs, and by the time the system triggers a halt, more usage has likely occurred. At the very least, I'd be fine with paying $X + 1 when I set an auto-shutdown threshold to $X if that was what they had to do to implement it.
Outside of that quibble, I find the other complaints to be less reasonable.
Back to your analogy. You get charge for these other dimensions that vary when you rent a car:
- make, model
- miles driven
- toll usage
- driver’s age
- duration of rental
The more accurate analogy here for the GP is the person returned a rental car to the wrong lot and was charged additional days until they discovered their error.
I fully agree. People use more and more bandwidth. It was just a question of time before someone started to use a petabyte a month. "Unlimited" makes no sense unless they are really ready to allow 100% usage of 1Gbps uplink all the time.
Nah, even with fully saturating the link you won't get there.
more like 5-6k max at a major IX point.
this also ignores how much of their traffic is settlement free peering to other adjacent ISPs.
Why ever not? If you sell someone something but only let them use less than 80% of it, that feels like fraud.
It’s total bait and switch, and probably false advertising/fraud.
Obviously that's not as good marketing. Products usually look better if you lie about them to make them look better. But lying in marketing shouldn't be legal. And this shouldn't be controversial.
Maybe because the limits are not fixed and completely depend on the spending of the customer? If a customer is among the top 1% of the biggest users and – at the same time – among the top 1% of the smallest spenders, that simply raises the costs of the service for everyone else. There are only three choices here: a) get rid of the customer; b) make them pay more, or c) raise the prices of unlimited plans for everyone.
For instance, OVH has previously terminated accounts of paying customers simply because it didn't want to do any business with people from an occupied territory[1].
Just don't call the plan "unlimited". Have well-defined limits. They don't have to be hard limits, they can be a gradual speed reduction after some amount of data per month. Just don't lie. I don't understand why you think this is a difficult concept.
BTW, if it was just "we don't want to do business with you any more", that depends on what your contract says. Most consumer ISP contracts allow an ISP to drop a customer for any reason without explanation.
Let's say the provider has a 100 Gpbs upstream, 1000 clients, and offers a cheap plan where you pay for 1 Gbps with no limit. The provider obviously can't provide a sustained 1 Gbps to every client 24/7.
Now, how do you honestly advertise that? Because you can give people 1 Gbps service so long not too many clients do that at the same time. And you can tolerate people downloading 24/7 so long they don't all do it at the same time.
How much you have to crack down will depend on how close to capacity you are, and what your clients are doing.
But a service with a cap also isn't unlimited.
Making a pricing structure which works for the company and is easy to understand for the customer isn't easy. Nobody said it was easy. But I don't understand how you go from that, to arguing in favor of lying to the customer.
In your scenario, 10:1 contention ratio, "up-to" 1Gbps throughput, 1Gbps link-speed.
In the UK British Telecom originally offered 'consumer' ADSL at 50:1 and 'business' (more expensive) at 20:1 contention ratio specifically to deal with the backhaul limitations.
If they advertised "you get a min of 200kbps, that could boost up to 1Gbps" that would be acceptable, as long as you actually got that 200kbps. The problem is they claim it is 1Gbps, then look at you funny if you expect 70% of what they claim.
But the fact that there is a limit at all, means that you can definitely display it somewhere.
Suppose you have two users, John and Jane, John is in the 1% of most valuable customers, Jane signed up last month. The data center has plenty of free capacity in June, but is closer to capacity in July.
Now suppose that each user has their own dashboard for resources.
John:
June - Your bandwidth limit is 200 TB. Please contact customer support if you need to increase it.
July - Your bandwidth limit is 160 TB. Please contact customer support if you need to increase it.
Jane:
June - Your bandwidth limit is 40 TB. Options to increase this limit will become available after X$ in total spend.
July - Your bandwidth limit is 30 TB. Options to increase this limit will become available after X$ in total spend.
As a matter of fact, Hetzner already has something like that under their "Limits" section: Limits
Limits are set per customer and are counted across all projects that you created. If you need more resources, just send us a request, and we are happy to adjust them for you.
Outgoing traffic to ports 25 and 465 are blocked by default on all Cloud Servers. Send a request for unblocking these ports. Please note that we generally do not answer questions regarding limit increase on the telephone.
You don't necessarily have to advertise the fact that your limits will be dependent on lots of variables and will change (though you should disclose it). What you shouldn't do is say that there are no limits, which is clearly lying. Even if the lie only becomes relevant to a very small part of the clientele who'll be affected by this, it's still lying.Of course, that's not the world that we live in and "unlimited" offerings will be a mainstay of marketing in the industry, for the better or worse. Probably better for the org and worse for the clients. Kind of why I also hate mobile carriers being dishonest with their data plans. It's like nobody even knows what "unlimited" means.
I'm proxying traffic through mobile proxies and expect nothing less than unlimited.
What herzer do amounts to false advertising when compared to the mobile traffic examples.
Words have meanings for a reason.
The meaning of the word "unlimited" is not, in fact, "limited, but we won't tell you what the limit is — you'll get to find it out the hard way".
Whatever the terms of the "fair usage" policy are, that's what should be in the description.
Otherwise, is plain old lying and misreading — which for some reason you are OK with.
Much like the Hetzner article, there's an obvious physical cap that can't be exceeded, and they're supposedly selling up to that cap.
I think that what a lot of people have problems with, is the fact that Hetzner doesn't actually tell you what is okay and what isn't. Would using 70% of the link's capacity be okay? What about 60%? Or maybe 50% is where they draw the line?
Here's another host that I use, Time4VPS, which have more clear terms: https://www.time4vps.com/?affid=5294 (remove affid for non-affiliate link if you don't want me to get a kickback in case anyone buys the services; I also host my blog with them)
Their servers include a guaranteed amount of bandwidth, either at 100 Mbps or 1 Gbps. And should you exceed that limit, they're also clear about what will happen:
> What happens if I run out of bandwidth?
> We reduce your VPS server’s port speed 10 times until the new month starts. No worries, we won’t charge any extra fees or suspend your services.
So if I'd exceed the amount that's given to me with any of their services, my 1 Gbps link would become a 100 Mbps link, or my 100 Mbps link would become a 10 Mbps link. On a technical level, it's obviously worse than Hetzner's offering (speaking of how much data you can actually move), but the transparency is nice and I wouldn't ever have to worry about my services being suspended because they don't automatically enforce any limitations just so they'd get to claim "unlimited" in their marketing materials.
Disclaimer: I still use Hetzner personally, they're one of the more affordable platforms (pretty much the same pricing tier as Time4VPS) out there. Though it's also nice when service providers have some provisions in place to automatically introduce limits for those things that could cause problems, like the amount of bandwidth that's available to you. Or just charge you for it outright, so there are fewer unknown variables.
For example, Australia:
https://www.gizmodo.com.au/2022/06/spintel-acma-unlimited-si...
I'm surprised my own residential grade connection hasn't been flagged, given I consume over 10TB a month.
[1] https://old.reddit.com/r/nbn/comments/hwz7l4/abb_cancels_ser...
"We had a good team on paper. Unfortunately, the game was played on grass"
Even in a private data center, you’d typically move a workload like that to avoid disruption to neighbors.
At a fast food places they advertise unlimited refills on the cup they sold you as part of the meal.
Here you are being advertised unlimited traffic on the port they sold you as part of the server.
Trying to liken using the port you are being sold as part of the server to driving up a tanker trunk to a fast food place is silly.
You will probably not stay in the establishment very long.
It is the normal operating mode of an internet connected server to send traffic to the internet - often even 100% of the time! It is the normal operating mode of drinks at a restaurant to be drank by the person while there, and maybe one refill for the road.
Trying to liken "Using the 'Unlimited' 1gbps port that was advertised "to "Refilling a cup and dumping it into a garbage bag" is ludicrous.
I don't understand why people are doing mental gymnastics to defend a bad advertising practice.
It is? I've been admining servers for a long time and I've never run one using 100% of it's upload bandwidth 100% of the time. I've never even run one at 80%. Being that near capacity means your service is about to fall over. Frankly for most services it's probably flagging.
In this case I suspect they assumed reasonable interpretation and customer interest: No realistic hosting provider can have the capacity to have every server utilize network 100%, but despite this the customer still benefits from increasing the uplink speed.
In my opinion, their limits are perfectly reasonable, the configuration is in the interest of the customer, and what is provided seems to be a reasonable interpretation fitting with existing definitions. It is only lacking documentation or unclear policy (one rarely plans for the unlikely, and I don't think they expected this), and something that should just be resolved by their customer service department.
Are you implying that this unintentional? That things like this are marketed without the full knowledge that such a service is impossible?
Sure, I might be within my legal rights to drop you as a customer the next month, but isn't it still a scummy and misleading way to advertise my service?
Eventually, you either get an ISP-like situation where everyone has caps on their "unlimited" service and there is no room to disrupt the market, or you get MoviePass.
There is not going to be a free-market solution to this problem, because no service with defined limits will be able to compete with the "unlimited" service at the same price point, and there are no consequences to simply dropping the expensive customers.
They are advertising that you can use 100% of your 1gbps link in a month then cutting TFA OP off at 80%.
If your interpretation of basic words is so wildly different from the norm that you already consider "1Gbps unlimited" a contradiction then surely you would never find yourself in a contract where subtler terms are in question.
1gbps maxed out for a month (you know, unlimited usage of a 1gbps line) equals 330TB (give or take depending on the length of the month).
If you signed up for a service which offered 50TB of upload then they cut you off at 35TB then you would be rightly annoyed.
If you have caps on your sevrvice? Cool. Don't use the word unlimited and inform customers of those limits.
Yes, if that's truly what the typical customer would want. But I doubt a typical customer would want only an ice cream cone after seeing that offer. However, if you offer "unlimited* ice cream", adding in the terms and conditions that it can't exceed 1 gallon per day, and 99.9% of users don't eat over 1 gallon per day, then I think it's fair to serve only 1 gallon per day.
Some years ago I purchased a (what I thought to be) huge backpack from an ebay store. it said 200 liters. What I got, I estimate to generously be around 75 liters. (by measuring the outer dimensions)
I complained, and they refused to budge, even after I showed them photos of the measurements, and they responded with "we have sold 3597 of these backpacks and nobody else complained about the volume, you must be wrong!!!" (i dont recall exactly if it was 3597, but it was thousands, and a specific number).
Clearly most people got what they expected, a reasonably large backpack, but not a HUUGGEE backpack. Was this okay? Was it acceptable I had to argue countless times and in the end contact paypal to get my money back?
Why is it okay because its hosting services?
edit: and it wasnt just misprint on the listing, the 200L was embroided into the backpack itself, and similarly on their smaller models, with the smaller number
If you really want to use this analogue, then the provider is getting upset after continuously providing 8000 gallons of ice cream every month to an individual who bought a single ice cream cone with "unlimited refills".
There are so many ways in our society where there's unwritten expectations. In this case, the unwritten expectation was that they weren't going to meter you and you didn't have to worry about overage charges, but that the 1Gbps should be thought of more as a burst rate than a 24/7 sustained rate. Likewise, I'd interpret it to mean that if I had a heavy month, I'd be fine.
If I'm a student paying for a dorm in college, should I be allowed to set up a mining rig pulling 10 kW and costing around $720/mo to run? Electricity is included in my dorm fee! I'm paying for it and I'm going to use it!
This is kinda why AWS nickle-and-dimes customers for every little thing - they had people who would find any area of weakness in their pricing model and go after it. I'm not even saying that people did it maliciously. Jungle Disk was a really cool idea: a mountable disk that used S3 to store the files. The problem was that it started doing loads of S3 operations. At the time, AWS didn't charge for operations and now there's this popular program doing a lot of operations compared to its storage and transfer charges.
As someone that has created SaaS software, some customer always comes along and finds an interesting use of your software. Sometimes it's a customer not really understanding the product. Other times a customer has found a weakness in the pricing model and they want to exploit it.
I get it the attitude. It's a war between you the buyer and the company selling a product to you. Personally, I'd rather have a more amicable relationship in my dealings. Yes, that means having realistic expectations about offerings including what might be marketing "puffery" (whether it meets the legal definition of puffery or not; https://en.wikipedia.org/wiki/Puffery). I'm not going to say that you're wrong to want 100% of the link 24/7, but then you're just talking about being in a situation where the company exercises their right to terminate your account (which you would have agreed to when signing up). Looking at Hetzner a bit more, it looks like they charge €1 per TB or $0.001/GB on their plans that have overages - 10x better than cheap places like Digital Ocean.
Yea, there's lots of places in this world where you can cause headaches for other people by using something in a way it wasn't intended that you're entitled to do - but you're going to have an unhappy time fighting for what you're due all the time. Instead, I'd rather focus on using things the way they were intended such that I don't create adversarial relationships with those I work with. Yes, in this case it would mean that I'd probably buy a few servers or just offer to pay them €200 for the extra bandwidth. Or I could fight, they could give me 30-day notice, and I could find another "unlimited" provider until they see me as a toxic customer and I start it all over again. Again, you're not wrong. You're just going to have an unhappy time trying to enforce your rights and get something better than the company expected to be giving you.
And of all the scummy things out there, Hetzner seems to be pretty decent. €0.001/GB overage on their limited plans is really cheap even compared to good deals like Linode and Digital Ocean (which charge 10x that). Their servers are really cheap. Their pricing is mostly very straightforward - maybe with this being an exception. I'll take a nebulous "it's unlimited, but don't push your luck" over what most hosting providers are offering. I could probably do 250TB for a month and they'd ignore it if it wasn't consistent. I can transfer way more than I get Linode or Digital Ocean and they'd ignore it. Maybe you just want me to say that you're right and that Hetzner is being evil and the person is due their 250TB of transfer every month, but I'd rather go through the world thinking that things are run by humans who want to do the right thing and sometimes don't anticipate all the consequences and then something like this happens - especially when the company doesn't seem to be doing evil stuff. Like, we've all seen surprise AWS bills in the tens of thousands without enormous usage. In this case, we're talking about a pretty small bill compared to the usage.
Yep, that person has the right to use that bandwidth - and Hetzner has the right to terminate a customer for any reason with 30 days notice. I'd just rather try and work with a company in a reasonable fashion if they're willing to work with me in a reasonable fashion. The alternative is becoming the customer that the company hates.
They do not state that anywhere in their advertising or terms of service.
They are advertising 1gbps/24/7/month as implied by their "Unlimited" terminology this is a perfectly measurable value and then cutting people off if they use 80% of that limit.
While I wholeheartedly understand that they can't offer that level of service for all customers and they expect most user to not use the full rate 24/7 and price their products as such.
If I'm being sold 1tb of transfer and am cut off that 800gb that is unacceptable, that is what's happening here (give or take some gigabytes).
If this is a problem for them then they need to change their advertising or terms orservice to state their Fair Use or AUP to list these limits.
Actually the written expectation was "unlimited" - without limitation. These so called "unwritten limitations" exist solely in your head, and are not suitable for companies to assume users inherently know.
That's still overpriced by a factor of 10. Hetzner overage price for the 10G link is 1 euro / TB or about $0.001/GB. That seems pretty reasonable.
So we're really looking at something more like $250/month.
Likely in this case, they can't upgrade their network fast enough, I'm guessing. And they don't have the funds to do it.
This would be a different story than my local cableco say. They will sell you 5TB of data for $100/mo. Or about $0.02/GB. But that money isn't going into network upgrades. And won't until they're forced to, since that's the cable company business model and has been for decades.
There is in fact a very clearly stated limit. It's unlimited.
I would personally assume that it would include 100% 24/7 (barring reasonable service outages). That's what "unlimited" means.
People who own dictionaries: this is a completely idiotic line of thinking. By which I mean "reasonable". Why, is there a problem?
Although I bet $LARGE_AMERICAN_ISP will not warn you, but just shut down your site and lock you out of your data.
IMHO Hertzer is the only hosting company that get what business it is in. AWS makes a ton of sense if you need to rent serious iron to do OCR on 100+ GB of scans of corporate documents, you need GPU power to train your AI model, or you are a startup that needs to grow 50% a month.
If you are an established company with a normal demand model, AWS will rip you alive.
Breakeven time between paying for GPUs, servers, and colo vs GCP was 3 months when I last checked. AWS was even worse. For training, cloud GPUs only make sense if you don’t have anyone on your team that’s familiar with physical infra or if you have a ton of free credits which is fairly common for startups with VC funding.
AWS is like a hotel. Great if you need it for a couple days, but you are mad if you want to live there indefinitely.
Do you live your day-to-day telling people lies or what?
None of that behavior sounds rational to me.
I can only imagine 'what? you thought I was going to paint the ENTIRE house!'
809Mbps costs $81/mo for a small provider.
So if a link is congested and a packet has to be dropped, then it is dropped from whichever user has sent the most packets in the last 30 days.
The end result is light users will get great service. Heavy users will start to see congestion at busy times, but will still be able to download as much as they like, contending with other heavy users at busy times.
Actual implementation can consist of say 10 QOS queues, where each customer is assigned a queue based on their decile of traffic sent in the last 30 days. Ideally you'd do strict priority on the queues, but I actually find it works better to say each queue has 2 packets delivered for each one of the queue below. That ensures that if a low use customer has a big burst of traffic, other clients still get a few packets delivered, which helps flow control adapt better. Also, rather than just ranking on 30 day traffic volumes, it works better to rank on 30 day traffic, plus 7 day traffic, plus 24 hour traffic, plus 1 hour traffic. That effectively means traffic sent in the last hour is counted 4x. That means users get faster feedback.
Do this and your company gets better utilization of network hardware too - every link will be 95+% full all the time. Thats better than the traditional model of building for peak usage and having links sit idle at 3am. There are plenty of customers who would love to use that cheap 3am capacity!
- The link says "my friend got this", so even the person who authored that post isn't claiming to have received this notice. This is a second hand report, at best. For all we know, their friend received this notice years ago, and mentioned it to the OP, who didn't realize it was old news.
- We don't even have a screenshot of an email like this (which could also be easily faked, but it would be more credible than that zero-effort text post), nor do we have any public statement from Hetzner.
- It's not like a flood of people are reporting this happening to them... I haven't seen a single person in this HN discussion mention receiving a similar notice from Hetzner. I didn't read the entire thread that was linked, but I also didn't see anyone there claiming to have personally received this notice either.
- The phrase "we’re writing to you today because of your traffic use" does not appear on any google results other than the linked thread, so this could be the first and only time that Hetzner has reached out to anyone about this, if it is even real, and even then... they might be motivated to cancel their contract with the customer for real reasons that they don't want to discuss with the customer, in hopes of lessening the drama. Companies do that sometimes, as crappy as it may be, so this whole thing could be a red herring if it only happens to one account.
If anyone does have additional evidence or anecdotes to contribute related to Hetzner getting upset at "unlimited" traffic usage, that would be nice to see. If this is a pattern that can be confirmed, then all of this discussion is absolutely warranted.
Hetzner might have sent this notice, but I've seen people get similarly flustered about other things on the internet that turned out to be fake. Can we gather some more evidence before raising our pitchforks? Literally anyone could have made up a story like this about any company, and people do make stories like this up.
Those are just my thoughts, but now that everyone has their pitchforks out, I doubt they are willing to provide benefit of the doubt to the accused party and wait for more evidence to show up.
There are at least two other posters in the linked thread that say they've received the same notice today (page 7). From the post history, one of them appears to work for a provider that I'd bet is reselling Hetzner boxes/slots on their boxes.
You pay for pipe capacity, you don't pay for usage according to sales page. If they want to change their business model they can. It's not my fault that I'm using what I bought to its full capacity
if they did not do this an ordinary residential last mile connection would be $250/mo not $50/mo.
heztner and OVH and other bottom of the barrel pricing hosting companies are their own special breed of thing.
you're not going to get for $40-50/mo what you would get for $250/mo.
their TOS/AUP almost certainly covers this (you think that a company the size of hetzner didn't run this by real legal experts first?). it's not fraud.
You go with Hetzner knowing you’re getting bargain prices, so they’re cutting corners somewhere. This would be like saying Walmart are committing fraud when it turns out their ham is not “finest quality”.
“We’ll of course they are cutting corners!” doesn’t seem like a defense at all to me.
If the sales page says "1 gigabit unlimited", I don't care about any other considerations. It either is or isn't "1 gigabit unlimited". If any part of that statement is untrue, then the the provider should be honest and say so.
I'm so fed up with the normalization of this slimy behavior.
The way I see it, this conduct is antithetical to the spirit of the free market and harmful to society at large, regardless of whether or not it can be defended in court.
Just to be pedantic, without disputing your broader point about what customers should expect:
Phrases like "finest quality" are known in marketing as "puffery" and companies aren't liable for these claims. From a quick search, specific factual claims like "unlimited 1Gbps" might be held to a different standard, depending on whether "no reasonable person" would take the claim seriously.
> The Second Circuit explained, "Puffery is an exaggeration or overstatement expressed in broad, vague, and commendatory language. Such sales talk is considered to be offered and understood as an expression of the seller's opinion only, which is to be discounted as such by the buyer."
> One type of puffery is a non-specific claim that one product is better than another The Second Circuit explained it as, "a general claim of superiority over comparable products that is so vague that it can be understood as nothing more than a mere expression of opinion."
> Looking at Starbucks's advertising, the court held that statements such as, "Best coffee for the best you," "taste of inspiration," "Starbucks or nothing," and "heart, soul, craft, pride, love; you won't find that in any other cup of coffee" are all puffery. The court wrote, "These statements vaguely assert that Starbucks's coffee is better than its competitors' in a manner best "understood as an expression of the seller's opinion only." They aren't, the court said, specific enough to "misrepresent an inherent quality or characteristic of the defendant's product."
https://www.lexology.com/library/detail.aspx?g=ac3f3d65-2e97...
'Fraud' is too strong of word. Almost everything in the world has some level of over-subscription. I don't know for sure BUT if every person and business turned all their water taps on full blast, I think we may have a problem.
Words are tools to convey information, if you label everything as fraud, that 'tool' is no longer useful.
Overselling capacity is perfectly fine if most of the time* you go to use the capacity it's there for you. If 95% of users under use capacity and you have the stats for it, it's perfectly reasonable to oversell sell with respect to the expected capacity usage. If those stats change, sure - they should adjust how much they oversell or what they advertise.
It's the same way a bank can't handle everyone pulling their money out all at once. It's perfectly reasonable to plan around practical scenarios.
Now if you rarely get what you paid for, sure, go for their heads over it.
* for some definition of most of the time aka get SLAs
At least in my experience, gigabit fiber is usually $100/mo in fiber markets. I would definitely pay $250/mo if it meant I had a guaranteed line rate, but I can’t. I think a lot of people would take $250 for guaranteed truly unlimited continuously saturated gigabit, actually.
if you found yourself operating a small regional bank branch or similar and wanted a business circuit in some suburb of a major city you'd more realistically be looking at $700-800/mo for a 1Gbps dedicated business DIA circuit on a 36-60 mo term.
The problem is they don't want to do that, because it's much snazzier to just market the peak speed.
How are you going to make sure every tenant gets its share of bandwith equally? It requires traffic engineering (like RSVP-TE, which in term requires an MPLS network.) and a proper QoS setup. both of which are not trivial to implement at scale.
Going further down the network towards to aggregate layer is far more doable (between switches etc), but doing it across core links it is actually quite difficult to guarantee bandwith.
Also residential ISPs generally don't even have SLAs so you could have days without Internet... probably also why they do not try to even hint at any guaranteed bandwidth. Depending on the situation, you might have none :)
If you bring a world eating champion to an all-you-can-eat buffet, they'll end up being refused service and banned from eating there after a few visits.
Attempting to apply a dictionary-literal reading of 'Unlimited' to a business advertisement of 'Unlimited' is unlikely to get very far in a court of law: such a literal interpretation attempts to create and exploit a loophole for one's own benefit at extreme cost to the provider, by refusing a common sense interpretation of 'Unlimited within reason'.
Saturating 1G ethernet continuously for a month exceeds what I consider reasonable, and I would not expect a court to be convinced otherwise.
it's a very common thing these days to buy something like a 1.5 Gbps average commit of traffic on a 10G 1310 LR hand off port to the ISP, and move traffic in a daily sine wave pattern that varies anywhere between 500 Mbps at 0300 in the morning and 1.5 to 2.5 Gbps in the evening peak.
It's not a "loophole" to use 80% of the capacity that was advertised and sold to you. If they want to sell "unlimited within reason" capacity, they should advertise "unlimited within reason", instead of "unlimited".
I really don't understand your viewpoint.
In the US, it’s unclear if my viewpoint is prohibited, and good luck to anyone filing a lawsuit. I would expect my viewpoint to likely survive a US court case.
Hetzner is based in Germany; I am not familiar with whether DE or EU laws prohibit them from terminating service at will when they feel that “unlimited” service is being abused. If you do research into that, let us know what you find.
Sure? I want stuff that works, damn if it’s cheap lol.
1) You have enough slack that your edge case top-end users can utilize what you advertise, and there are enough people not needing it that this is all fine
2) You do not have enough slack that your edge case top-end users can't utilize what you advertise, in which case you are, at best, being deceptive in your advertising practices.
No one cares about the former, and even though the latter is common place, that doesn't mean that it isn't a shitty advertising practice nor should someone making use of a provider have to know that this is common place.
You should be able to reasonably expect to get what a commercial entity is advertising itself as giving as part of your payment to them. Just because this industry has been garbage about it doesn't mean that it should always be garbage about it.
This person is probably paying like 50 bucks a month or less and is in the top 1% of bandwidth users as measured by individual ethernet ports from a top of rack aggregation switch or similar.
Raises hand
The fact that these kinds of lies are normal doesn't make them OK. Instead, just... don't lie.
i should also note that a very common reason for a dedicated hosting company's server to go wild on upstream bandwidth is something misconfigured or compromised, and being used maliciously by some external 3rd party. not actual bandwidth usage from the paying customer. this is mentioned in a nicer way in the email.
they probably could have just cut them off arbitrarily. nothing obligates them to keep a customer.
this is actually really nice on the part of the hosting ISP in my opinion.
If you have a sustained near 800 Mbps of outbound traffic you should be doing it from something much more serious than an absolute bottom of the barrel lowest cost no-SLA dedicated server.
this is "unlimited" in the same way that an all you can eat buffet restaurant is unlimited, with some caveats.
It's not that big a deal. People lie tons. It's not murder. But it's still a lie.
98% of your customers show up and eat three gargantuan heaping plates, are totally satisfied, and can barely walk back to their cars.
the other 2% show up at 3 in the afternoon, stay for six hours, eat ten plates of crab legs and roast beef.
maybe you notice those 2% of customers and say nothing.
if the same person comes back every week and loads up on ten plates of crab legs, you nicely remind them of the socially acceptable use of an all you can eat buffet.
https://blorg.org/wp-content/uploads/2020/02/Bacchanal-buffe...
"[don't do things that] impairs the regular operating behavior or the security of our infrastructure or our product" doesn't make it very clear that there are data caps.
yarrr, tis not a man, tis a relentless eating machine
Yeah of course you made certain calculations when you started your business, including that most people would start loading up their (small) trays with the first items, which are the cheapest and so not cost you much, but you also accept that not everybody is going to do that.
A business is a business and social acceptableness has nothing to do with one another. One is a business and the other is a social situation. If I know you personally, it is a social situation. If I have paid money, it is business situation.
Lying to close a deal is fraud: they should have disclosed the limits upfront.
If they want to charge for high utilization of bandwidth, they should bill for traffic — like everyone else.
I’ve also never had a buffet try to restrict “unlimited” in the way you’re suggesting — they’ve been quite upfront about their restrictions.
There's a difference between saying "unlimited" and "up to n Mbps * t transfer per billing period".
We don't know or care how our packets are being measured. If there's a limit to them beyond the physical link, then it's not unlimited. "Unlimited packets internally but we will reduce the egress rate after a certain amount" also isn't "unlimited".
Threatening termination for using what was advertised does not seem very nice to me - especially when they specifically removed traffic limitations: https://news.ycombinator.com/item?id=18120500
It seems pretty damn simple. Hetzner used to have transfer limits. It was 20 TB for cheap servers when I was using them (2017-2019). It was bumped up to 50 TB in 2020.
I don't disagree with you that a user consuming 250 TB of transfer should be paying for that transfer, though. I'm disagreeing with the marketing. It's deceptive, and it causes problems that are the genesis of this post. You know what's supremely simpler? Just commit to a hard limit on transfer and be done with it.
Well, they could put that in the policies or the offer. Or be more specific in the email.
But 1G isn't really that much. I don't have a use for that much bandwidth at the moment, but it's not like you need that much compute to pump out 1G, so pick the offering with enough compute and enough bandwidth, and there you go. You don't always need an SLA, especially if you can load balance over multiple bottom of the barrel hosts. Unmetetered 1G for not a lot of money is a credible offer, so I'd take an established provider at their word; lots of hosting offers have a port speed and a traffic limit and overage fees listed.
Unlimited plans exist because demand isn't consistent, and shared bandwidth provides a way to lower prices. If I was guaranteed max bandwidth on 5G all the time on my cellular plan, I'd pay a lot more than $40/month.
Okay, so the ISP expects that people won't use what they're sold. That sounds like their problem and their bad planning.
That means a lie was told.
The reason for not continuing the service means they lied. That it doesn't violate their ToS is beside the point—they offered something that they did not intend to let people actually use. The evidence is precisely the fact that they'll stop doing business with you if you actually use what they sold you (and don't agree to pay them more money).
"Well, no, because now we know you'll actually use what we say we provide, and we don't really want to provide what we're offering—that part's a lie."
It'd be different if they'd responded by discontinuing that kind of plan entirely.
This seems pretty straightforward to me.
The 99% pay for the 1% that actually uses the unlimited traffic
Can't have your cake and eat it too.
The part of the T&C they point to just says they can terminate any contract for any reason. That's a pretty lame way to resolve what is basically a marketing problem -- they want to sell a bandwidth-limited service as unlimited i.e. lie about it.
Say what you will about fair use policies, but at least they spell it out.
The part of the T&C they point to just says they can terminate any contract for any reason.
First you say they need to honor their contract and then say they're honoring their contract. What's the problem? Similarly if someone runs a restaurant with an "All You Can Eat!" special and someone comes in with a 40 gallon drum and starts filling it up from the buffet, that person is going to be asked to leave immediately.
There's no possible way that Hetzner could a) Predict every way someone could abuse their system and b) Put them all in their marketing materials. So they have that clause in their contract and they're using it.
"All you can eat" means all the individual customer can eat (usually within a time frame). If you offer it and then stop offering food when customers (in your opinion) eat too much, then that's fraud.
You literally made up the restriction of, "usually within a timeframe".
The same for hosting. If you make your offer unlimited and don't make any exceptions explicit, then your offer is unlimited. The least thing you have to do is to add a little * and list the exceptions in every advertisement. Otherwise it's deceptive advertising and bait-and-switch fraud. It's really very simple.
> First you say they need to honor their contract and then say they're honoring their contract. What's the problem?
The contract terms don't actually say they can terminate a contract for any reason, though. They actually say they can terminate a contract "for good cause", where "good cause" is explicitly undefined.
They'd be on better ground if their contract really did say they could terminate it for any reason.
you think an ISP the size of hetzner or OVH or similar has no TOS/AUP that they put a lot of time and thought into before publishing, and putting in the customer new-order workflow?!??!
It feels a bad-faith interpretation of the "Customer uses content that impairs the regular operating behavior or the security of our infrastructure or our product" portion of section 2.7.
Connection: 1 GBit/s port Guaranteed bandwidth: 1 GBit/s Traffic: Unlimited *
*Traffic usage is unlimited and free of charge. Please note that our unlimited traffic policy does not apply to servers that have the 10G uplink addon. In this special case, we will charge the usage over 20TB with € 1.00/TB. (The basis for calculation is for outgoing traffic only. Incoming and internal traffic is not calculated.) There is no bandwidth limitation.
If they want to say, "you can't saturate your link 24/7 for multiple months" then they should say that.
What's the problem, exactly?
The point is that advertising "unlimited 1Gbps" pretty much explicitly says that it is OK to continuously run at 1Gbps.
Closer to top .1% in all honesty
This is not to say that I don't think 250TB is excessive, but sales transparency is important.
Yes, they provided a very good service for the money they received. One would be hard pressed trying to find a better deal. Yet, they did lie.
Specifically, it's misleading publicity. AFAIK, that's an issue in Germany. They did the bare minimum to not get into any legal issues, but if they insist on the publicity message, they will very likely have problems.
They really shouldn't try to mimic an US company.
We give you unlimited depending on overall network saturation and conditions. Offer a live dashboard and prediction on where you are and how you may be throttled.
Otherwise also offer pricing per GB transfered.
I agree, this person is for sure costing the company significantly more than they're worth.
The correct solution is to fire the marketing team, and grandfather "unlimited" plans.
I also take issue with "up to" and other vagueness. There should be clear metrics and sizes that are precise and not abbreviated in all ads and offers; and offers should also be public and non-discriminatory. A 'service check' for an address should also constitute a 'binding offer' (I.E. the ISP had better be very sure service can be provided at that address!)
Ok, 100mbps.... to where? The switch you're plugged into? The router at the data center? Some other random host in the network? Some other random host outside the network?
So yea, everything on almost every network without a dedicated circuit is 'up to' simply because you can make no other guarantees.
Simply sending packets down a wire usually limits one to the physical speed of the interface, but even then some kind of packets might get dropped by various filters/mechanisms along the way.
For instance, should i be able to use my full bandwith of my connection by sending purely BUM traffic down the link? Somewhere in the network, some policer is going to start dropping BUM traffic to protect the network against flooding.
I'm assuming modern systems do this better, but I've learned never to make assumptions when they benefit the billing party more.
For instance, do you charge for the overhead of the Ethernet frame? What about additional size thanks to tunneling/encapsulation?
One could argue that no, you should not charge a customer for that because that is part of local transport inside a layer 2 domain, which is not in control of the customer.
But what about things like MPLS labels? you could go and on and on..
The other case is that you buy a specific usage tier, but that is probably going to cost a lot more, which is why "unlimited" plans exist.
And that's the thing: most people don't want to worry about this stuff. It's a minuscule fraction of people who care. And you just need to recognize that you're in the minority.
Every infrastructure is based on the principle that nobody will use all of their ability at the same time. Road network? Good luck with a whole city in their cars at the exact same time. Power distribution? Tell that to the british grid when all of britain turns on their kettles at the same time during sports events (live broadcasts are out of phase from regions to the next to alleviate this issue). Or to their sewage system, where all toilets flush at the same time once the human byproduct of said kettles is produced.
So yes, this is a hosting provider where the bandwidth is shared, they overcommit it, otherwise they would not be able to do them for that cheap (in case of hetzner), or at all at a profit (for other providers that are not bottom-end). Here they tell it is unlimited, because there is no data cap. The same goes for virtual machines in a cloud environment, those too are overcommitted, and I can guarantee you that if you spawn AWS instances and use 80% flat of CPU 24/7/365 you'll get the same kind of email directing you to the cpu dedicated instances.
Actually, they even did you a favor for not kicking you out due to "trust and safety" flagging you as fraud (like sending spam or ddos, which they 100% should have btw).
I don't see how a cloud provider can complain about high CPU-usage if they bill by the machine and by the minute. Otherwise 20% of your bill is for idle CPUs.
It really boils down to the business impact you have on them. Sure, you pay for the resource, but they are not guaranteed. And it is up to their discretion to de-prioritize your VMs on the HV, so that you're the last to get scheduled when the host's CPU is starved. This is the whole 'CPU credits' thing on AWS that they document in [0] where you can burst above the baseline. Interestingly, note that the baseline is in the 30% ballpark in their illustration on the bottom of the page :)
[0]: https://docs.aws.amazon.com/AWSEC2/latest/UserGuide/burstabl...
It's also fraud because AWS get to charge me when I'm not scheduled, but they also charge the users who are scheduled on the contended CPU. They should bill by the CPU cycles I consume.
Anyway, we've moved from AWS. Lucky escape.
> Traditional Amazon EC2 instance types provide fixed CPU resources, while burstable performance instances provide a baseline level of CPU utilization with the ability to burst CPU utilization above the baseline level.
If the provider you are working for is doing this crap, then it sucks.
Yeah, that's bullshit.
There literally is a data cap...and it is one which Hetzner refuses to specify. The unspecified data cap is "drastically lower" (in Hetzner's own words) than even the 80% usage which the customer was hitting.
If you have to use drastically less than 100% usage, then those numbers should absolutely be published and using the term "unlimited" instead of publishing the limits is highly unethical.
The "other companies do it too" argument is silly since the behavior shouldn't be normalized in the first place.
This is a pretty significant claim that I think we're going to need evidence of. I would be flat out shocked if any of the major cloud providers gave you this sort of notice.
All of them have burstable instance types with various mechanisms for limiting that burst, but I have never heard of anyone ever getting this sort of email just for heavily and consistently utilizing CPU on a regular instance.
However, I will agree that this sort of thing around "unlimited bandwidth" is normal in the hosting industry. People talked all the time on webhostingtalk about all of the different dedicated server and colo providers that advertised "unlimited" bandwidth and would cut you off if you actually tried to use eit.
(We work with >200 different hosting providers around the world)
Oversubscription is normal and I am happy to pay for a service that is oversubscribed. I just want to know what I am paying for. Am I paying for "guaranteed X GB/month, up to X+Y GB/month"? Cool, I love it. Are you gambling that enough users will sign up and pay you to subsidize unlimited bandwidth / unlimited storage / unlimited anything? I want to know.
A normal business relationship with a vendor should be profitable for the vendor. Yes, I have an interest in paying less money for services--but being able to use those services at all is usually more important than squeezing a few bucks in discounts out of the vendor. If my deal with a vendor is unprofitable for the vendor, it creates a risk that the vendor will in the future terminate the relationship, discontinue the service, or even go out of business.
It's up to the company to figure out what the right SLOs/SLAs/SLIs are. That's actually a core part of what I am paying for when I sign up for cloud services or colo services or whatever. There's a delicate balance where you figure out an SLO that is possible for the company to support, while still looking good in marketing materials, and understandable by technical end-users.
If your company provides infrastructure without SLOs, or if key SLOs are missing, then I'm going to be a bit hesitant. A missing SLO is a sign that your company hasn't done the work of figuring out how supportable a particular feature is (like "unlimited bandwidth").
Relevant xkcd: https://xkcd.com/1499/
You cannot fill up your car's tank with soda at a "free refills" place, neither can you camp and eat 24/7 inside an "all-you-can-eat" buffet.
I don't think it's unreasonable to still call those services "unlimited" and let the restaurant/internet provider decide when to drop a customer that they don't want in their premises/on their infrastructure...
If the restaurant sold 'Unlimited Soda, 2 liters per minute, £50/month' I would expect them to deliver on the very specific quantities they promised at the price they offered. If they tell me I'm over-dispensing, I think I'd be rightfully annoyed that they have over-promised.
Instead, Hetzner sells "unlimited bandwidth" the same way McDonalds sells "free refills". It's also understandably unreasonable for someone to start pushing data at the max rate for months non-stop, the same way it is unreasonable for people to fill 50 large cups with soda.
If people have accepted the "...within reason" argument for free refills and all-you-can-eat buffets, why not also accept it for data usage?
False Advertising. Simple as.
And even if you were right, even if it's just a case of false advertising and the provider wanting to get out, there is nothing wrong (neither morally nor legally) for them to unilaterally terminate the contract, which they could have well done instead of writing that notification letter. They explicitly state this in their TOS. Most companies can still (luckily) decide which customers they serve and which they don't
(If you're really lucky, you might be able to get 900Mbps or so, but that's not likely: the max throughput on 1Gb Ethernet is below 950Mbps, even if you had packets flowing continuously!)
They also said the use averages above 250TB.
It averages on multiple of their servers, which indicates to me that the average was taken over the course of some months (?). They may well have reached 320TB in some months on some servers.
I'm not surprised by this. For me, unlimited traffic (with 1 gbps) means i can spike in some months without having to worry about costs exploding, but if I'm maxing it out consistently, then I might be asked to move to a different service or upgrade.
If you are subscribing to something and the subscription price changes, that's not "lying", that's one party renegotiating. Furthermore, Hetzner's legal agreement allows them to do this.
Sure, Hetzner could publish "up to X TB / month" (and it sounds like it should considering their apparent audience). But let's have a little empathy here, sheesh.
Whether or not something is technically allowed in the fine print is different from whether or not it's a shitty thing to do. Having secret, unpublished limits on a supposedly-unlimited service is shitty. They'll be getting no empathy from me.
No, just as you said with your underpaying hypothetical, the customer is free to drop Hetzner. A rolling term contract protects both parties. If this person pushing 250TB/mo can find a better provider, then they should move.
If they can't find a provider willing to offer cheaper bandwidth than Hetzner...well, that tells you everything you need to know about this situation.
Pull the other one.
This is blatantly NOT fair use. I doubt that they in fact have a specific limit (having worked for large hosting companies with "fair use" policies in the past, it was "you'll know it when you see it"), but whatever limit you might choose is frankly well below this.
Yes, calling it unlimited is a bit misleading, but they truly can't compete with everyone else (who do the same thing!) if they don't. At this point, with how widespread it is, you should frankly assume that unlimited = fair use, and be working for it to change politically, not getting mad at companies.
I would also note that it sounds like their use has been consistently high over several months, which (IMHO anyway) lends some credence to calling it unlimited (as opposed to f.e. AT&T where "unlimited" means a set number of GB each month...).
Hetzner tracks outbound bandwidth only, the relevant servers are uploading, not downloading, >250TB/mo.
It might just be a tale as old as time.
Here it's simply a matter of money. If more than 200TB/month triggers an angry email, then just state they have a limit of 200TB instead of stating unlimited. It's not so complex.
Lol, as if that is unimportant.
> then just state they have a limit of 200TB
They don't have a limit of 200TB. They take issue with sustained saturation over a long period of time.
> It's not so complex.
Can you imagine how complex it would be to publish a schedule of every single consideration? They certainly won't take issue with 250TB of internal traffic. So now they need to start differentiating egress. Would they take issue with 250TB of ingress? It's less likely, but they would probably have higher tolerance for that. So now you have another schedule. What about cross-datacenter traffic? Boom, another policy.
Have you seen AWS bandwidth pricing? How in the world is that less complex than just addressing abuse on a case-by-case basis.
Maybe I'm wrong, but I imagine it doesn't cost much more to run a network that is 80% saturated vs a network that is 5% saturated?
Basically, why can't they just fairly throttle high usage users when utilization ramps up, and then unthrottle them when usage lowers?
Edit: I'm not talking about them reneging on their guarantees, which they've already done by asking the user to cut their usage.
(It's also awful with EBS)
> Typically, instances with 16 vCPUs or fewer (size 4xlarge and smaller) are documented as having "up to" a specified bandwidth; for example, "up to 10 Gbps". These instances have a baseline bandwidth. To meet additional demand, they can use a network I/O credit mechanism to burst beyond their baseline bandwidth. Instances can use burst bandwidth for a limited time, typically from 5 to 60 minutes, depending on the instance size.
It's a lot less work to bill on usage (or cancel accounts for high usage) than to throttle high usage users to keep the network responsive for all users.
The operators are likely paying for usage as well on their paid connections, or indirectly in that as connections fill up, they need faster or more ports and that comes at a cost. It's one thing if your peak traffic comes at their off peak times, but it's more typical to have peaks around the same time as everyone else.
>... We will routinely check your traffic use. If we continue to see such a high amount, we may choose to cancel your contract. (Please see 2.7 of our Terms and conditions ...
>2.7. Furthermore, we reserve the right to terminate the contractual relationship without notice for good cause. Such good cause is deemed to exist, among other reasons, if the Customer fails to meet its payment obligations or violates other important customer obligations. A further important reason which may result in us locking or terminating the Customer’s services or account without notice is if the Customer uses content that impairs the regular operating behavior or the security of our infrastructure or our product, or violates paragraphs 8.1. - 8.3. of these Terms and Conditions.
>8.1. The Customer is obligated to check and comply with the legal provisions arising from the use of the contractually agreed services, in particular the Telecommunications Act, the Telemedia Act, as well as national and international industrial and intellectual property rights, personal rights, and the requirements of competition and data protection laws on their own. The Customer indemnifies us against all claims of third parties arising from infringements of these obligations.
>8.2. The Customer is obligated not to publish any content that infringes on the rights of third parties or otherwise violates applicable law. This includes in particular, but is not limited to, pornographic or obscene material, extremist content or content that offends common decency, gambling, material that could seriously endanger the morals of children or young people or violate the rights of third parties (copyrights, name rights, trademark rights and data protection rights). This also includes the publication of defamatory content, insults or disparagement of persons or groups of persons.
>8.3. The transmission of spam mail is prohibited. This includes in particular the sending of unauthorized, unsolicited advertising to third parties. When sending emails, it is also prohibited to provide false sender data or to disguise the identity of the sender in any other way. The operation of applications for mining cryptocurrencies remains prohibited. These include, but are not limited to, mining, farming and plotting of cryptocurrencies. We are entitled to lock the Customer’s access to their Hetzner services or account in the event of non-compliance.
You’re confident that this person is engaged in spamming? Or wait no, copyright infringement? Or wait no, illegal content?
Are there any legitimate use cases that might use a lot of bandwidth?
I could imagine hosting 4k video. Or a software archive. Or image hosting. Or hosting podcasts, ML models, backup services, OS images, high traffic forums, public domain archives, adult content (which is not disallowed by Hetzner), etc.
I’ve noticed a lot of people starting with the premise that “It’s okay for Hetzner to lie to customers” and working backwards to enumerate reasons why it’s not only acceptable, but good and necessary. It’s a strange phenomenon.
Since we don't know what causes that much traffic my guess is as good as yours. Those servers are like Schroedingers cat in a superposition, hosting legal and illegal content at the same time.
Hetzner would probably be my first choice. Even though I’ve hade some strangely slow connections there sometimes.
Other more enterprisey providers like Datapacket seem to be significantly more expensive.
I front my Hetzner instance w/ then, works great.
There is no unlimited data. Either data centers are lying to you, or they're going to end your contract the month after you start sending hundreds of TB.
Their data plans clearly state the traffic limits and their terms state the overcharge you can expect. If you need more network traffic than the 15TB they offer VPS servers, you can probably just ask, set up some dedicated , or set up a CDN (listing price: "contact us", though Cloudflare is likely cheaper) or rent yourself a full colo rack.
Other VPS providers are similar, but always check the uplink speed (I've noticed German and French providers tend to stick to only 100mbps) and the data limits; anything that sounds like "unlimited" isn't and should be avoided if you're worried about data cost. Your only real option is to avoid the cheap market and go midrange or high end because data is expensive, especially at over 800mbps consistently.
I was thinking that maybe some provider basically was reselling ≈FDC dedicated boxes with VPS's that tailored to high bandwidth usage. Of course being more expensive than run of the mill VPS's. But maybe the server performance per price, and bandwidth price equation doesn't make it so attractive. Even if you're just pushing static files, you need some CPU to saturate it (especially considering tls termination)
Scammers.