Poll of Facebook Users Finds 94% Hate Redesign
techcrunch.com
techcrunch.com
I don't know whether this stat is valid or anything, but I think Facebook just has a different social graph than sites like Twitter and that Facebook's graph isn't people you want these style updates on.
Second, the number of respondees or the proportion responding a certain way are irrelevant if the sample is biased. The poll is designed in a way that practically guarantees bias: a self-selected sample, a hot-button issue where one side cares much more strongly than the other, and the viral hooks of Facebook to make sure it gets spread far and wide.
It's worthless if you're looking to draw any real conclusions about how Facebook users feel about the new homepage. It's not worthless if you're looking to exploit people's confirmation bias and get an article all over the web.
So, YMMV, I guess.
http://www.insidefacebook.com/2008/12/16/facebook-now-growin...
It also reports 13 million users log in once per day. That, in the context of Facebook, is what I'd call an "active user". These, overwhelmingly, are the people who are taking this poll. 700,000 therefore represents about 5% of the core userbase.
Your math here is really flawed. Facebook's daily uniques are a magnitude smaller than their weekly and monthly uniques. Since this survey has been up since the redesign, you would have to compare 700k to the number of uniques over that period of time. I can assure you that number is much greater than 13M.
True, 700,000 is not a staggering number for Facebook, but is a statistically signifiant portion of their most active users. I wouldn't put money on the figure of 94%, but I think it correctly indicates a strong trend.
It actually doesn't matter with respect to the more salient point, which is that talk of "statistical significance" is irrelevant because the calculations require an unbiased sample. As I outlined above, there are at least three strong reasons to suspect this poll is irreparably biased.
Self-selection alone is typically enough to condemn a poll. Look up the history of Gallup if you want to see the real-world impact of self-selection in polling.
For the record: perhaps 10 of my friends have voted no. This is not a significant percentage. Of those 10, probably about 8 of them did it as an impulse vote and 2 actually got annoyed at the layout.
Correct. Ordinarily, the ABSOLUTE size of a sample is more crucial than what percentage of the whole a sample makes up, for determining whether the sample is adequately large, but that is only if the sample is unbiased. If that precondition is not met, don't talk about how large the sample is, talk about how badly self-selected "samples" can misrepresent the characteristics of a population. Thanks for reminding HN readers about this important issue.
But there was just the same outrage over that design for a good month. I probably got 10 group invites to groups like "new facebook sucks!" and "don't visit facebook on (some date) to show them how much we hate new facebook."
I'm not sure if anyone took a poll, even a biased one, but I haven't noticed among my friends any more outrage over this redesign than the last one.
> This application was not developed by Facebook.
Edit: Looks like Arrington updated the headline after someone pointed that out... still not a very clear headline since it misleadingly labels this a "Facebook Poll," when it is in fact a Facebook app that is polling users.
Perhaps semantics, but an important distinction given that actual Facebook polls are only available to Facebook.
Edit: also only 9 big stories on home page... wtf. And older posts returns "There are no more posts to show right now" after just two clicks.
The highlights, display new photo groups... yet a selection of the photos are displayed on the home page anyway. The entire highlight section is completely moronic, it just displays less information in a less convenient way and there's no way to control, remove or filter any of this.
I really don't need to know my wife's cousin has joined the 'I Love Sex' group when I've already removed her stuff from my homepage.
I also have serious problems with Facebook's 'People You May Know' crap, because it's completely unintelligent. There's no way to prioritize your relationships with people, so I'm suggested friends of my wife's cousins who live like a 28 hour drive away. My wife doesn't have the person on, I'm not down as living anywhere near the person... so why does it suggest them to me off of 2 people I know who know them, but doesn't suggest a single one of my wifes friends?
It failed to suggest a family friend who comes over for coffee like 4 days a week, yet it has suggested me someone from a different country before despite having less mutual friends.
In particular, I like that I can just type whatever I want as a status message instead of Facebook deciding that my message should be 'XYZ is <fill in>".
You can tell that this update had a lot to do with simplifying localisation, in fact. A lot of text is gone. Instead of saying that someone was "tagged in 4 photos", it just says their name and shows the photos.
Somehow, having your name at the start of the textbox (and not being able to erase it) seemed to force status updates to be terse and, well, third-person. I've noticed that just in the last few days, this beautiful brevity has completely disappeared.
[Edit: but I concede that it probably didn't work so well for other languages...]
VOLUNTARY RESPONSE POLLS
One professor of statistics, who is a co-author of a highly regarded AP statistics textbook, has tried to popularize the phrase that "voluntary response data are worthless" to go along with the phrase "correlation does not imply causation." Other statistics teachers are gradually picking up this phrase.
[quote=Paul Velleman]
-----Original Message----- From: Paul Velleman [SMTPfv2@cornell.edu] Sent: Wednesday, January 14, 1998 5:10 PM To: apstat-l@etc.bc.ca; Kim Robinson Cc: mmbalach@mtu.edu Subject: Re: qualtiative study
Sorry Kim, but it just aint so. Voluntary response data are worthless. One excellent example is the books by Shere Hite. She collected many responses from biased lists with voluntary response and drew conclusions that are roundly contradicted by all responsible studies. She claimed to be doing only qualitative work, but what she got was just plain garbage. Another famous example is the Literary Digest "poll". All you learn from voluntary response is what is said by those who choose to respond. Unless the respondents are a substantially large fraction of the population, they are very likely to be a biased -- possibly a very biased -- subset. Anecdotes tell you nothing at all about the state of the world. They can't be "used only as a description" because they describe nothing but themselves.[/quote]
Way to take a hard stance. </sarcasm> I think that this redesign, like the others, will face opposition from nearly everyone at first and once people get used to it they will like it or at the very least accept it. I think that quote says it all. The user is unwilling to stop using the site despite hating the design.
I can't see why they would want to "catch up" with Twitter, a distant second place in the social networking race.
Another good article is "Facebook's Lousy Facelift" here: http://www.huffingtonpost.com/chris-willman/facebooks-lousy-...
Good general principle.
On my part, Facebook is less addictive to me than it was before the change. I could easily forget that I'm a member, as nothing interesting is happening there.
Perhaps that's why I don't get a lot of these complaints. I block apps as a matter of reflex, so the only app stories I get are from Digg or Last.FM or Google Reader - those I can appreciate.
I think facebook's main problem is that they could gradually make changes, piece by piece and no one would ever really notice. Yet they change the entire home page and you get reactions like this because the feel is drastically different.
What the users say about their opinion of the new design is completely irrelevant. Users who are used to something will always resist change that removes something they are used to. The proof will be in the usage statistics. Eventually Facebook will saturate the market and at that point they may end up with more to gain by maintaining some level of familiarity. But for now I think they are making the right moves to increase engagement, and I believe the numbers will bear me out.
The only thing comparable in the Apple world is the release of OS X. At the time there was A LOT of complaint, much of it extremely well-reasoned. Diehards clung to OS 9 for years for pure interface reasons. Of course Apple didn't take quite as big a public opinion hit as Facebook due to the technical benefits and the horrible obsolescence of OS 9.
Does Facebook need to avoid this backlash? Only if people actually stop using it, which seems unlikely.