Cloud Hosting Showdown: DO vs. Linode vs. Vultr vs. OVH vs. Scaleway
webstack.de
webstack.de
Scaleway is part of the Iliad family of companies, which you probably haven't heard about if you're outside of Europe. This includes Online, a networking provider and Scaleway's parent, and Free, which is a huge French ISP with a fairly hackery internal culture.
Online makes their network map public:
Based on the names, it looks like it's 100% Cisco with a mix of Nexus 9000s, Catalyst 4500e edge, and 4900 ToR switches.
Scaleway is one of the only cloud providers I've seen that is using NBASE-T technology. The Intel Avoton SoCs used by their C2 instances support 2.5Gbps link speeds using an appropriate external PHY.
Their C1 instances are Marvell Armada 370 XP parts, datasheet here:
http://www.marvell.com/embedded-processors/armada-xp/assets/...
These are using 1 gig connections. The instances I've spun up connect to a gateway with a Cisco MAC address.
The C2 instances connect to gateways with MAC addresses registered to Freebox SAS. Figuring this out took some digging. It turns out that Scaleway/Online is manufacturing their own 2.5G capable switches. Because Free, the ISP, already has an OUI registered and was the only company in the conglomerate which made hardware, it looks like Online had Free make some custom switches to deploy in their datacenters.
They're also making their own BIOS for the C2 instances. dmidecode reports the following cutesy BIOS data:
Manufacturer: Online Labs Product Name: SR Version: (^_^) Serial Number: 42
The root devices for C1 and C2 instances are both NBD. Performance was better than I expected; I get wire rate I/O throughput on both (>90MB/sec on C1 and >250MB/sec on C2). Of course, the disk bandwidth is shared with the Internet connection on both instances, so there might be contention for some applications.
Anyway, thanks for doing this digging, it's interesting. Scaleway has its shortcomings but I find it to be one big fascinating experiment.
I can understand for a site that didn't need CPU-heavy performance (I intended to use it for a personal Nextcloud instance) but my main issue was with reboot time. Change any settings in the control panel? Reboot needed. Applied kernel updates and need to restart? Wait for that reboot. It was agonizing, I had to abandon the process and check back an hour later to see if starting or stopping the machine had completed.
Even when I decided I was done and ready to cancel, one more wait of 40+ minutes for the machine to shut down so I could delete it and release the reserved IP. I admire the fact that they decided to try something very different, but forcing every customer to copy the entire contents of their drive to a second device and then copy it all back again to restart is nuts.
Currently on OVH for most things (by far the best performance/price ratio for my usage) but still keeping a couple DigitalOcean VPSs due to concerns about OVH's 'special' version of Ubuntu[0], which has me concerned. Hope that's resolved soon or I'm back to DO + AWS as a Plan B.
[0]https://insights.ubuntu.com/2016/12/01/taking-a-stand-agains...
However I do find myself using Linode lately as I get double the memory for the same price. I hope DO follow and increase the memory on their nodes.
A weird thing to say when most people I know who use them are doing it for the cheap price.
I believe it'd be more appropriate for Linode to say that, which has long had good reputation in terms of the variety of regions, the quality of network, etc., and which used to be on the more expensive end. DO, on the other hand, actually debuted with the low prices, if anyone remembers.
The article mentioned dataloss with Linode... I experienced the same problem. Well, technically the data was there, but there was a corruption problem and the disk was being mounted read-only. Their default settings for ext4 in their arch linux offerings was not 'data=journaled', and it should have been.
Well... I say it should have been, but I found out why it wasn't their default when I went to rebuild that VPS. Apparently something in their infrastructure doesn't work well with ext4 journaling because everytime I tried to set it to journaled (so I could avoid a repeat of the corrupted disk issue...) it would reboot lmounted as readonly and there was no way to fix the issue except to rebuild.
When I contacted them about it, they told me it was a "known issue" that would be fixed in the next 3-6 months.
That was the SECOND issue I found with them, the first is that doing a 'pacman -Syu' on a completely fresh install would hose the install... again, something to do with their infrastructure not working well with arch linux.
It took me days of fidding around and learning what I could, and could not do, before I was able to successfully rebuild that VPS.
I would absolutely love to find another VPS provider that offered arch linux with comparable performance.
[0]: http://rclone.org
I'm curious to learn more about this. I'm currently using OVH public Cloud, and before doing so I was trying to find some review about it. I must say that so far I have no issue with it, but I have been using it for 2 weeks only.
When you say unusable, do you mean it was down or simply too slow? I read a lot of complain about the speed of the storage, but nothing about the stability of their cloud.
Any details would be appreciated.
For OVH http://weathermap.ovh.net
International airport https://en.wikipedia.org/wiki/Frankfurt_Airport
https://en.wikipedia.org/wiki/Frankfurt
International finacial center. Like second financial center of Europe after London.
Today it still makes sense to go there because Germany is the wealthiest country around, and from there you can serve the entire Paris-Brussels-Amsterdam-Frankfurt area, which includes a lot of people: http://kids.britannica.com/comptons/art-143547/Population-de...
edit: before I get punched by an autist, Frankfurt not ON the Rhine, but it has an incredibly quick access to the Rhine without being subject to its floods.
BTW: both have more expensive offerings if you need strongers SLAs. What I don't like with OVH's offering is that they have 3 different brands (OVH, SYS and KS) and you need 3 different accounts, control panels, and even invoicing is not consistent over the three brands (which means more work when doing my accounting every month...).
I will also second the comment on the confusing offerings of OVH, though. Their three brands are one thing, the other thing is that even their main OVH website looks totally different (with different products being offered) depending on which country you select on the top right. I have the feeling they are working on this right now (their different country websites are beginning to look more and more similar), but it can be really confusing. Also, chances are high that you will end up in some French configuration menu eventually. (I can understand that they will find this a bit unfair, as all the other players of course can just develop their websites in their native language and don't have to worry about this. But still it's not that professional.)
On the other hand, for a German test I find it interesting that they didn't include netcup, which also offers very cheap and high-quality VPSes from Germany (although they suffer from the same confusion regarding their websites - when you switch to English the products are different and for some reason much more expensive than on the German version).
And then, of course, there is also time4vps.eu if you want to go really cheap.
Load balancers are a must have infrastructure puzzle piece these days. DO did a fantastic job on their lb offering and for $20 a month they are quite powerful (http and tcp) with configurable health checks and failover.
Allows me to have zero-downtime upgrades by switching servers out of the rotation, and also not be concerned if individual servers die or are rebooted (which is very rare anyway).
Qualys gives the site an A, but says of some browsers: "Server negotiated HTTP/2 with blacklisted suite" so I imagine this is the cause of the problems?
https://www.ssllabs.com/ssltest/analyze.html?d=www.webstack....
Edit: This was with FF48 on Linux. Restarted Firefox to get v49 and it's working now.
I'm ok with uploading those documents when signing up for an account on financial-related online services (btc exchanges, online debit card, etc), but I would never comply with that just for testing some cheap VPS. Why would they need those info when other vendors don't is beyond me.
I read recently that Digital Ocean added that but not sure about the others. It is one of the reason why we're still on AWS.
* IPv6
* floating/elastic IPs
* API, wrapper libraries, CLI tools
I agree about additional IPs and API/CLI tools though.
Not a shill, just a happy customer.
1. OVH: OVH is great, cheap and very reliable. I have used a $3.49 instances there. The only thing with them is a very complicated control panel to use. But the disk space is kind of expensive to get extra space.
2. DO: DO is the worst I have used. They are lock my account forever and I'm unable to get any data out. The issue is I have tried to create two account that using same credit card. I tried this to take advantage of their free $5 credit. It's my fault I know. But at least they should merge the account, not suspending me.
3. Scaleway: Scaleway is great but not very consistent, sometime they seems very fast. But then suddenly the instance is not reachable for a short amount of time(30-60seconds). It happens several times a week. Doing anything there will require shutdown servers which may take more than 10 mins. Such as shutting down server to create snapshot.
4. Vultr is the best among these. Its offer great, consistent performance(CPU plus network). I used them to run monitoring agent which fetch thousand of websites to monitor them without any issue. Their control panel is the best too.
But. I can confidently say I would seriously consider quitting my job if forced to use OVH in a work context.
Linode on the other hand actually do things like respond to support requests, often in a helpful way even.
Ouch.
Scroll down and you will see they peer with Google Fiber, Google Cache, CloudFlare, NetFlix, Yahoo, etc. and others.
I used them for a client about 18 months ago I think, no problems and could get continuous 80Mbps over many hours to/from the servers the client rented.
unless it has changed or varies by datacenter, DO issues a /124 by default -- I've confirmed this on my own droplets just now. issuing a /64 is "proper" because it is RFC[1].
Linode was too pricy for what they provided back when I tried them, too. At this point I would only use these providers for a personal website, but I would choose the cheapest, and get an identical second provider and dual host for redundancy.
Even if they were more reliable systems than they are now, the bigger they are the more they attract attacks on their core. Only the giants like Amazon and Google, or more professional (read: expensive) providers have the resources to deal with it.
I have several DO droplets running, one is running for 4 years now, zero downtime. I heared about some problems but that were no massive outages, but rather single host systems failing, which is no problem, since you should built your application that way that one VM failing is no problem. It happens everywhere, on Bare Metal, on AWS, on Google Cloud, etc.
Linode cut their pricing (or rather improved their plans) and started offering a $5 plan, I don't see how they are too pricey compared to the competition.
You pay a massive amount of money on AWS to be protected against DDoS, otherwise they will just bill you the bandwidth costs (that are very very high compared to those companies compared in the blog post).
OVH has openstack support in some regions and that is the current defacto non aws / Google / Azure cloud competitor.
And, all of the big providers have their own issues - cloud computing is hard, and no one has it 100% yet.
> Even if they were more reliable systems than they are now, the bigger they are the more they attract attacks on their core. Only the giants like Amazon and Google, or more professional (read: expensive) providers have the resources to deal with it.
While, yes they may not have the capacity themselves to swallow a large ddos, there is service providers who do, and any iaas worth there salt will have a contract with one or more of them.
You do realize that OVH weathered DDoSes largee than 1100Gbps in the past, without issues?
And that, like Scaleway, it belongs to a large french ISP with a nationwide network, own backbones, and they are even developing and using their own hardware?
These are giants.
But it's a bit strange for an ISP to develop its own hardware, and ddos prevention has nothing to do with system management or cloud hosting feature sets. Furthermore, those two are the least mature, slowest, tiniest, and most limited providers in the shootout on every metric except perhaps network performance in France.
For an ISP that, 5 years ago, was the largest hosting provider on the planet, and is still an ISP in several countries with their own backbones, custom hardware is not unusual.
You don't complain when Google or AWS develop custom hardware, or when Level3 develops custom hardware.
Why would OVH be different?
> and ddos prevention has nothing to do with system management or cloud hosting feature sets.
No, but it's something you complained about, although OVH managed to successfully handle the second-largest DDoS known to date without downtime.
It's very obvious you're not familiar with them at all.
Sounds like AWS - they explicitly state that you can't count on their stuff and you need to engineer your stack that way.
edit: oh I see now, that difference for scaleway should probably be placed as a footnote of the table
I have snapshots of my Scaleway servers sitting there right now. I've also never experienced any downtime (6 months and counting).
I'm not saying anecdotes are completely without merit, but they don't pair well with rhetoric.
Stop kidding about "snapshots". They don't offer snapshots at all. Period. You should shutdown your server through the fucking dashboard before you can click the snapshot button. Snapshot is an instant backup made on a running server, otherwise it's useless.
Tell me what you want but I know what I've seen for 3 years with them. Now I and my company are running DO servers, which is way better for the price.
Anyhow, semantics aside, I seriously wouldn't recommend DO for any serious work. It's fine if you freelance in Wordpress or other off the shelf products but if you have any serious work to do then just don't even waste your time with DO as it's solutions are slow, inflexible and, in my professional opinion, immature when compared to other leading cloud providers.
Anecdotally, I've had a good experience with them. I use them as a playground for ideas or learning things like docker/kubernetes.
I see no reason why a properly architected deployment would have trouble in their environment.
Direct link to the benchmark: https://serverscope.io/trials/lrAw
Special pricing for startups: https://www.ssdnodes.com/startup-specials/
/shameless plug
We're trying to go in a different direction from hourly, and instead offer very deep discounts for annually. So customers can get 8GB RAM for $6.49/month ($77.99/year) and have stellar performance with a provisioning time of about 10 seconds.
I understand your direction and it makes sense, but please don't advertise in a post that is reviewing providers with a specific use case (hourly billing) that you don't offer. Thanks.
Moreover, to me, regular VPS == openvz and not hourly billing (openvz would also disqualify ssdnodes).
As it is, your original response comes off as more than slightly rude, and your subsequent response was very rude.
OpenVZ, when used properly, provides us with massive performance gains along with the flexibility of "live scaling." Since we're providing containers, our customers can scale up to a larger plan with zero downtime. Their RAM and disk resources are available immediately after choosing the next package (additional cores require a reboot).