The more of these tests start appearing, the better.
With Cloudflare I'm guessing it's a more balanced measure.
The other side of this is why Netflix created Fast.com in the first place: ISPs throttling Netflix traffic (or just having poor peering arrangements that affected it) and blaming Netflix when customers complained about poor video quality (due to Netflix downgrading when experiencing congestion) because some speedtest (that likely the ISP prioritized, or at least knew it had better peering to) gave good numbers.
> With Cloudflare I'm guessing it's a more balanced measure.
Both serve the same purpose for their respective owners: to get good scores on fast.com an ISP can't throttle (or allowed to be throttled by avoidable congestion) Netflix traffic, to get good scores on speed.cloudflare.com they can't throttle (or allowed to be throttled by avoidable congestion) traffic to/from Cloudflair's topologically local DCs.
From a user's point of view using both, plus other tests, gives most meaningful results overall.
It's hard to guesstimate the exact bandwidth of the data that arrives in your browser because of differences in protocol, MTU, header compression and all that nonsense, especially over technologies like WiFi. In my experience, the WiFi throughput numbers seem spot on.
Their compensation makes for some hilarious statistics, but when you're downloading more than 200mbps the fast.com speedtest doesn't make much sense anyway. No way in hell is Netflix going to allow your single home internet connection to somehow pull in a full gigabit of streaming video. If you're your own ISP you can make it happen, but on the other hand you'll probably also know how to get statistics directly from your network hardware, in which case the fast.com numbers are useless but it still becomes a useful way to spike the load.
Netflix's speedtest is mostly reliable for what it's meant to do, which is solve the question of "my internet is fast but Netflix keeps buffering".
Edit: another factor to consider is that accurate timing has been disabled in most browsers because of side channel attacks like SPECTRE. It's possible that those are affecting your measurements at very high speeds.
And of course, I'd not expect them to want me to pull down 1gbps of streaming video. But I would expect them to burst my connection when downloading videos for offline viewing, their own bandwidth permitting. Unused bandwidth at a point in time is wasted bandwidth. But more central to my original point, I'd also expect their browser-based speed test to not claim I'm going faster than is physically possible. Let's be honest - however they're measuring the actual connection speeds is not as accurate as some of the alternatives on the same playing field.
Well, Europe has lots of different countries and I've definitely been in countries that are considered to be in Europe where it's not equally fast, and using a VPN can speed up a lot of things.
I would be curious about concrete examples in Europe, though
That's exactly what the person above you meant about Cloudflare, right? By using the Netflix speedtest as a benchmark, you're promoting good connectivity to another commercial entity (for good or for bad, I don't mean to judge, just stating)
This is abused for "unlimited data" subscriptions that aren't unlimited when you actually try to consume more data than a standard subscription would allow you to. Of course that's completely illegal in countries with net neutrality laws, but not every country has those.
I can't think of a reason why a shitty ISP would throttle Cloudflare, as Cloudflare mostly hosts small files. As an ISP you want customers to think websites are nice and fast, because if only Netflix is slow, surely the problem lies with Netflix, right?
If speedtest.net says you have gigabit, Cloudflare says the same, and fast.com is giving you 5mbps, your ISP is messing with your bandwidth. It could be that Netflix has technical issues, but you'd read about those. That's why these tests are useful, and why we need more like them.
In Nederland? I only heard these stories from the USA, and then specifically about monopoly ISPs with Netflix as trial target to see if they can get extra money from them
I haven't caught any real ISP here (only train/public WiFi). I don't trust Dutch ISPs to follow the law so I do run these checks every now and then.
At least one American mobile carrier overtly advertises "5G" with "unlimited data" followed by "DVD quality (480p) standard" video quality, but not every carrier in every country will be that direct.
Interestingly, if you hide the tab running their speedtest you get even higher speeds.
I find fast.com more accurate than most, going by the throughput I see to/from other resources, particularly for upstream rates (which some, including Cloudflair, seem to significantly under-measure). Of course this may vary depending on line type (FTTC, “up to 67Mbit down n& 17 up”, generally seeing more like 50/12) and location (due to differences in local network conditions and peering between you & the speedtest) to I'm not surprised to hear you see the results quite different to those I experience.
> if you hide the tab running their speedtest you get even higher speeds
I suspect this is due to your browser throttling CPU use and timer granularity for background or occluded tabs⁰ reducing the accuracy of the readings, if the code isn't working to mitigate the effect of these throttles on the calculations.
--
[0] refs: https://blog.chromium.org/2020/11/tab-throttling-and-more-pe..., https://www.reddit.com/r/incremental_games/comments/jefviz/f..., and many more
Ideally settlement peering would exist for everyone. Cloudflare, like every other sane provider prefers IX routes over PNI since it's less expensive for everyone involved. There really shouldn't be a discussion about whether peering should be settlement free or not.