Why YouTube buffers: The secret deals that make and break online video
arstechnica.com
arstechnica.com
We desperately need to break up ISP monopolies and enact strict net neutrality regulation and bandwidth (even latency/routing) guarantees. The idea that a single ISP is in a position to charge both YouTube and its customers is bizarre. By any basic reasoning, an ISP that doesn't enable access to YouTube should be out of customers within a few months. That this doesn't happen is testament to the broken market surrounding internet access, and a bad sign for the fights that await us.
(Google needs to start naming and shaming the ISPs that do not want to peer with them on reasonable conditions or with sufficient capacity when they detect bad performance on YouTube. They have been doing this locally, e.g. they delisted french news sites from Google News when these lobbied for protectionist laws, and they have been stating the parties that forbid them from showing copyrighted content, e.g. the GEMA in Germany.)
What's your stance ? That's a very valid question regarding relationships between individuals, with the law and authorities in one group.
http://en.wikipedia.org/wiki/Organ_trade#Current_Restriction...
It's not a perfect analogy, but as the old saying goes... "If you put the federal government in charge of the Sahara desert, in 5 years there would be a shortage of sand".
The internet already exists. All of today's problems are minor in scope to the original problems of connecting the nation together. Why turn it over the government now?
We could have a FRAND like situation, where backbone network entities has to sign a Reasonable and non-discriminatory agreement regarding traffic flows. FRAND like systems has it own set of issues, but it has also clear benefits.
Government is the second obvious one. As with roads, government benefit greatly from improved infrastructure. All roads do not benefit from being toll-roads, especially when the traffic flow can radically change overnight. Who knows where the next youtube will be, or if google will move the servers suddenly after a SOPA directive is voted in.
Lastly, government could loosen their total control of the electromagnetic spectrum. Doing so would enabled a true global mesh network to be built, giving anyone with a receiver/transmitter the ability to participated. So long government claims to own the communication layer in the air, I will hold them responsible for the current communication issues in the cables.
Customers would then be able to pick and choose their carrier and carriers would be forced to compete based upon service. Not happy with ISP A? Call up ISP B, sign up, and they'll put in a ticket to a tech at the facility to patch you over from ISP A to ISP B instead.
I realize, of course, that this a fantasy that will never happen.
http://arstechnica.com/tech-policy/2010/03/how-amsterdam-was...
That said, I pay my ISP for bandwidth and service. It's bullshit if they refuse free installation of caching servers which improves my service and frees up upstream bandwidth for others.
Great for whom? Legally mandated fixed fee services are generally not the highest in customer satisfaction.
If you don't meet their requirements (which are based upon average aggregate traffic levels), you can't even pay them to get one.
If your ISP meets the requirements and is refusing, well, it's their own damn fault -- they're simply wasting money.
Personally, I am happy to peer with anyone with whom I share a presence, even if they're an "eyeball network" like me and we'd only be passing a few megabits of traffic.
why is this bizarre?
you pay for hosting, yes, of course. You don't additionally pay individual ISPs to guarantee it's users access to your sites.
Besides, one nitpick: the Google News story was in Belgium, not in France.
Belgium http://www.bloomberg.com/news/2012-12-13/google-belgian-news...
I have never had any of the problems described in the article. I live in the UK, and use a small ISP that prides itself on giving me a high quality service. And I get it.
Edit: downvoting? Really? If you disagree, then why not provide an actual explanation of why fixing the monopolies won't fix this problem on its own in a reply?
I don't think the US government (or those of its several states) is competent enough to regulate the complex interconnections between networks. I predict that the major ISPs will be able to find new tools to degrade network conditions faster than regulators will be able to sanction them for it, should the government choose to go after this fight at all: the essential abandonment of the wholesale provisions of the Telecommunication Act of 1996 ended the possibility of reasonable widespread competition for broadband: lack of choices is why this is a problem in the first place.
Some even go a step further, inspecting unencrypted HTTP traffic and replacing referrer IDs and such on advertisement links (e.g. links to Amazon).
Your solution is to have the government, through legislation, control how bandwidth is rationed? Yes, by all means, instead of degraded YouTube performance, let's just cut everyone's bandwidth across the board to some idiotic bandwidth guarantee. As if the government would somehow magically be able to better ration bandwidth than the companies that, you know, actually provide it.
A better solution might be to get rid of regulations and try to lower the barriers to entry, so that it's easier for smaller startups to get into the same space as the ISP's. "But limited infrastructure, blah blah, whaa whaa." Shut it.
Google shouldn't be the only company with the ability to create new infrastructure (like inflatables). But since regulation around internet infrastructure has to be micro-managed by so many levels of government, it only makes things harder for the non-Googles.
I walked away from the article much more skeptical of the value of net neutrality rules.
Are you going to have a law that requires someone maintain all their equipment? How will you know what's "maintained enough?" What about the companies that didn't deploy as much capacity as service providers wanted? How will you eliminate the appearance of favoritism in regulators enforcing something so vague?
That said, I'm all for breaking up monopolies and punishing collusion though, that seems like an easier fix, something we have more experience enforcing.
[1] - Apparently they added this quite recently http://www.ghacks.net/2013/04/06/youtube-introduces-ultra-lo...
You know you have fucked up player when congestion control http requests spam more than video stream itself.
It makes no logical sense for the player to reload something that was already loaded since that would handily double their traffic (if only in this situation).
Which makes me think they don't actually buffer anymore. The bar just shows a standard, imaginary amount of buffering by default and nobody really cares.
It makes me very uncomfortable how "true" that feels.
Making a general video host is so expensive and complicated that we may have to just resign to use YouTube for at least some more years... but it's easily one of the worst user experiences regarding online videos.
Netflix does this too and it drives me nuts, especially when I'm watching something in HD because it automatically switches to low definition for a few seconds until the high definition version is loaded.
But the ISP makes a gigantic difference. I have the benefit of a great ISP (smallish in size, no surprise) and seeing all the youtube jokes about ads always working but not the videos themselves made me somewhat puzzled, as the very few times a video doesn't stream it's just as likely to be the ad that pauses as the main video, and that's super annoying because you can't skip ahead in an ad like you can the main video. I figured that other ISPs were worse, but there must be some exaggeration going on for comedic effect.
Then recently I was at my parent's house for a while, where they are on Time Warner. I really had no idea how unusable it could be. Constant pausing of video for loading every 20 seconds or so, waiting at the very beginning of almost every video, not knowing if a video was loading or there was some kind of error and the page needed to be refreshed.
I'm really used to checking youtube for how to do basic household tasks. Often you'll have to go through two or three to find a good video on a subject. You can't do that at all in that environment, as the waiting is just too much. I'd switch to 240p just to get the gist of a video to make sure I wanted to watch it, so definitely forget any movies you want to see with good quality video. I would queue up videos so at least something was buffered, which meant you have to plan ahead on what you want to watch, totally changing how you use the site.
It's really like a totally different product. I think of youtube as the wikipedia of home repair and cooking (or maybe more ehow or whatever, but the point is that it has an expert video for everything) and I also use it for constant mindless browsing and watching interesting talk after interesting talk, quickly deciding if something is worth watching within 30 seconds by scrubbing around in the video a few times. You can't use it for either of those things, and the desire to pull out your hair while waiting for anything else taints any other use, too.
If I was on that Time Warner connection, I wouldn't be making jokes about how ads always seem to buffer just fine, I would be completely puzzled how other people would think that Youtube was in any way worth using. It really felt like stepping back to dialup.
My connection isn't especially fast, but maybe my ISP does the local CDN thing. People should try it out, because I suspect the transition the other way would be closer to a religious experience, or like stepping out of a time machine. Meanwhile Googlers working on the youtube player might want to all get a Time Warner connection, as maybe designing for that (as opposed to more specific bandwidth or latency limitations) might make for a better player for the many suffering people out there.
I have their second-highest tier, 30Mbps down / 5Mbps up. The speeds I receive are pretty consistent, even during peak hours, according to speed tests.
I often find that YouTube will either work splendidly on my TWC connection, or it simply won't work at all. In other words: perhaps 80-90% of videos I can seek to a new spot in a 1080p video w/o any perceptible buffering... the other 10% of the time the video just refuses to load, or seeking is horribly broken, or it cuts off before the video is finished.
I guess I would agree that, for the videos that fail, YouTube _does feel_ like a different product.
(I should also add that, in my case, advertisements usually work even when the video fails to load.)
It replaces the YouTube player with the standard html5 video player. This alone made my experience on YouTube way better. My connection is slow, so many times I'll just open a YouTube video in a background tab, and leave it loading for a while. With this, I can just preload the whole video. And seeking doesn't make the video reload.
A side bonus, also, is that every video will use the html5 player, so making flash useless on YouTube (one of the few sites that make me keep flash installed). It will also remove the ads, so it might not be your thing for moral/ethical reasons.
My slow 1.5mbps Internet has had awful youtube experience since the player change. I have been downloading most of the videos directly to avoid using it.
[0] https://addons.mozilla.org/de/firefox/addon/video-downloadhe...
I've only used it a few times but it seems to work well. You can choose which video (resolution/quality) to download and then I usually watch 'em later using VLC.
https://addons.mozilla.org/en-US/firefox/addon/1-click-youtu...
I noticed that they introduced this feature around the same time they removed the right-click option to stop downloading the video.
Moreover, the little that is prebuffered seems to behave oddly, you skip forward well within the indicated area that have been buffered, yet the player seems to reset and start re-downloading that part -> unueably slow.
It helped a lot, especially when YT was slow as hell on Free in France.
This accomplishes two things: It allows third-party analysis, and it provides early warning of change to affected parties.
I think something like that must exist for windows and Linux, but I could not find anything free.
The former does what needs to be done, and all pitch in to move traffic. Suits on the other hand only see $$$.
As for the suits: either your are overselling your bandwidth and you don't have enough money to make the necessary changes REGARDLESS of where the traffic is going/coming from. Or your just being greedy !
To fight this, I think it's best to get review ISP by their real speed. Then getting this information out to the public. So people can select the best ISP, and natural selection of the fittest(fairest ISP) will occur.
I could envision using a random YouTube/Netflix/Hulu video for a test to be done across several providers at the same time. Add some legal torrent and FTP servers as you're at it.
That way you get results that can be compared directly. For end user results, you really don't need to be that thorough when comparing results (after all, if you're doing at different times on different you are already adding unhandled variables) you just use any random video from one of those providers.
Unfortunately it doesn't measure real content providers so it may not detect peering problems.
So Verizon and Comcast can compete with Netflix, or they can attempt to cut off their knees.
"Nice streaming service you got there. Be a shame if it was so slow your users got frustrated and cancelled their service."
This is why Verizon and Comcast don't take Netflix up on their offer to provide caching servers, create peering agreements and take other actions that actually decrease the ISP's cost. Because Verizon and Comcast want Netflix DEAD.
Does this mean no one will every be a true competitor to Youtube or match its performance unless they pay all the local ISPs?
Once net neutrality is broken, the market is also broken.
Almost everyone who is on Comcast (myself included) during peek times experiences lag that makes the game unplayable. Your character "skates" along the map and usually when it buffers and catches up to you you'll find yourself dead. My friends and I got together to play over the weekend and ended up having to stop due to the lag.
Heres a thread where the guys at Riot are trying to identify the issue. It wasn't until 7/22 that they identified the problem everyone has been having was due to a peering dispute between Verizon and other vendors. To fix the problem they are having to make changes with their provider to route traffic to bypass problematic junctions.
http://na.leagueoflegends.com/board/showthread.php?t=3521364
Its been very eye opening to me. I have a 50mb connection and I always thought that as long as I had a faster connection I wouldn't have lag issues. It was disappointing to learn that regardless of your connection you can still be throttled by ISPs and their vendors.
I'm sure you must have a decent ISP somewhere down in the states. If not, perhaps you just need to wait for google to do it.
Other yards are owned by mean people that don't want to let the dog through unless it's owner (your ISP) pays them more money. If the owner doesn't pay more money, the mean yard owners will make the pup sit there and wait for a long time until they say it's okay to go (LAG).
And sometimes, the mean owner have so many dogs waiting in his yard, he decides to throw them into the street, where they are never seen nor heard from again (packet loss).
Most people could definitely change ISPs and avoid the troublesome vendors their ISP is currently peered with but I live in a town (low population) and unfortunately Comcast is about as good as it gets.
One way to get around it is to route my traffic through a proxy to bypass the troublesome vendors but that would degrade my bitrate which is frustrating since what I really want is to just get what I am paying for 50/mb and wish the internet providers would just work it out.
According to the article Comcast are trying to charge Google for letting Comcast's customers watch youtube, which is a weird and evil way to do business. I think it basically boils down to Comcast being a really shitty ISP and you (unfortunately) not having much choice.
The irony here is that Comcast is a 10x larger company than Shaw, so perhaps it's just a case of Comcast throwing their weight around and basically resorting to extortion.
I wonder how prevalent and successful such fraudulent upselling is?
For youtube's client side player this is completely intolerable. Which is why you don't depend on youtube's clientside player for anything. Use SMplayers downloader, or youtube-dl, or videodownloadhelper. These make use of more dependable protocols for downloading the video, and they will download 100% of the video.
You can buffer several videos up and watch effectively.
My user experience is so much better than what people experience through official channels. How can that be? I hacked my user experience together with bits of string and duct tape. Why should my experience be so miserable on official channels when so many manhours have supposedly went into making that experience the best?
Should you really be losing out to bits of string and duct tape?
What the ISP's are doing to youtube isn't fair, but the ISP's are clearly not the only ones at fault.
I had a pathetic experience with an ISP "reselling" Bell's DSL service. The ISP's name is Distributel. YouTube would not, at "peak times" (6pm - 9pm on weekdays, most times on weekends), work at 1080. The download speed forced you to wait for the entire clip to pre-buffer before it would be possible to play it.
What was frustrating was that opening an SSH proxy to a US server (hosted at Linode) and going through that proxy would allow you to watch 1080 clips with plenty of pre-buffering headroom. I tried to explain this to tech support (with bandwidth measurements, etc) to no avail.
I finally switched over to TekSavvy who have always had their shit down. They truly rock (the tech support is amazing).
I wish I had TekSavvy. I really do. Next time I move I'm checking which telecoms I have access to. If it's only shaw or telus, I'm demanding discounts.
Now the only problems I have are with the semi-broken new player, fast forwards and rewinds are often broken, full screen doesn't always full screen etc.
YouTube usually works quite well on my network (TimeWarner Cable in SE Wisconsin, US), but occasionally I'll be completely unable to receive HD streams of certain content, so I have to select 480/320p to buffer the video at all.
Today, with the explosion of online video, the copyright-clearance step could be administered by companies (as it already is, e.g., YouTube), but the servers providing distribution to the users at the network edge do not have to be run by companies.
1. Recall that storage is quite inexpensive and users are today quite capable of providing their own at home or on-the-go storage for terabytes or gigabytes of video.
2. Recall the "content-centric" networking idea Van Jacobsen has presented to Googlers. Does it really matter where the user gets the content? No. What is important is that it is authentic (and copyright-cleared).
I dug up a link that I saved:
http://mitchribar.com/2013/02/time-warner-cable-sucks-for-yo...
Here is the fix:
sudo ipfw add reject src-ip 173.194.55.0/24 in
sudo ipfw add reject src-ip 206.111.0.0/16 in1 - http://www.wired.com/wiredenterprise/2013/07/google-internet...
ISP's or not, it is infuriating for me as a user to see a website get significantly worse as it gets bigger and bigger.