Testing a few new designs that don't show the public dislike count
twitter.com
twitter.com
Use report button
edit: Or another relatively common type, not necessarily fake or even strictly misleading, just cynically low-quality: a video made by pulling some text content from the web, feeding it through a speech synthesiser, and playing that over over the top of some 'relevant' images.
For the past couple of months I was regularly reporting group of spammers spamming links in comment sections but to this day I still see them running amok.
If YT removes the dislikes from the public eye, I will either have to scroll ahead, OR watch 5-10mins waiting for the thing to start, then go and try some other video.
YT increases user engagement (I have already watched 10mins of one video and now heading for the next.. and the next.. and the next..). So, for YT this is a win-win.. it's the user that gets tricked.
Bravo YT, well played (not!)
This is the sort of thing I had in mind. Some of it is complete junk and some is probably interesting to some people, but the titles are sufficiently misleading to attract an eye-catching number of downvotes. I can't remember exactly when I last came across this kind of content, but it was definitely quite recently, so I don't think youtube has stamped it out.
There was plugins that showed it when browsing and it made such a difference.
Oh, that's still happening. It never stopped.
Likes (and dislikes) are needed mostly for viewers who might want to feel helpful.
Dislike mobs do more harm. They probably ignore dislikes already.
1. Videos which promise to show something that never actually appears
2. Very short videos which are difficult to not watch in their entirety
One of the most powerful media platforms in the entire world can institute a change like this under everyone's watch, and none of us have any recourse.
A couple of programmers in their two-week sprint can fiddle around with some Javascript and push it out to the masses, and suddenly large swathes of the historical record are gone forever. (If you consider downvotes to be historical, that is.)
Imagine if someone could white out a section of a book and apply the changes instantaneously to every printed copy of that book in existence.
I think about the implications of being able to look back on human history, and how that historical narrative is increasingly in the control of technology companies and a relatively small amount of people who decide to change that narrative for everyone else. I remember many chronological videos that specifically call out the dislike ratios of some YouTube videos as evidence of the negative backlash certain companies or individuals have received. With no dislikes, that point can no longer be made. That information is lost.
During a live recording of a Japanese entertainment group I watched, whose videos will be preserved on physical discs and be watched by thousands for decades to come, they announced on camera that, in the span of their two-hour performance, they had reached trending status on Twitter. All they had to mention was the word "trend," and the audience responded with enthusiasm. The influence of Dorsey's creation has permeated so many of our lives, including the people who, ten years ago, would never have cared about what bizzare-sounding technologies like Ruby on Rails would eventually enable them to obtain: a universally understood, instantaneous signal of approval.
I believe that the record of who we were and what we did will be important for us to be able to look back on, as it has been for centuries. But it seems that, in the coming decades, that will not always be up to us to decide - just a couple of people in the engagement bureau who decided for us that the alternative was better.
Considering a fifteen year old YouTube video can resurface and the millions of votes can change the vote-ratio, digital media isn't necessarily the same as a permanent historical record.
Unfortunately, the 'dislike' signal on a YouTube video doesn't tell me if it's because an expert disagrees with its content, or because the creator is being brigaded, or because the downvoters disagree with their politics (related or unrelated).
The comments are a better signal, but looking through them requires reading... YouTube comments.
My options now would be to spend a minute or two watching it or reading the comments (engagement!), which may not exist on some niche videos you run across for things like this. This adds up when browsing. Don't forget creators can disable comments too.
But I guess that happens anyway.
Fully agreed with you on everything you said here, but that specific line I quoted sounds a bit optimistic to me.
You would only waste a minute or two if the video author decided to actually start his video "for real" from the very beginning, instead of spending the first few minutes on his entire life story (that is not even related to the video content) and asking people to like and subscribe. It became so commonplace, these days I instantly start liking videos just for not wasting the first few minutes on things completely irrelevant to the actual content (which would be somewhat fine for entertainment videos, but definitely not for things like DYI tutorials and lessons).
And don't forget the Wadsworth Constant :)
https://www.dictionary.com/e/pop-culture/the-wadsworth-const...
Edit: YouTube algorithms are so smart* I was exaggerating using hyperbole(figure of speech) in order to imply strong impression and feeling that YouTube algorithms are good enough for YouTube to afford dismissing dislike button.
Instagram is doing fine with likes only so I don't see a reason why YouTube wouldn't. Go to comment section to say what is wrong with the video you are watching or use report button if the video is violating TOS.
No, the real issue here is too many of the "right" things are getting downvoted. So when The White House, Disney or the Academy disable downvotes on part or all of their videos but other wide swaths of videos don't need to disable downvotes, the contrast causes them to stick out like a sore thumb.
It calls attention (also known as engagement) - but not the kind of attention those who run social media companies want. Attention that is counter to the desired narratives is unacceptable. So here we go with the lame excuses that are all the sudden relevant when they weren't when the like/dislike stuff was instated decades ago?
Give me a break.
I'm sure YouTube consulted with their biggest customers and partners before removing a functionality that increases engagement
What I firmly believe, based on statements by the companies and the employees that work for them as well as their actions (over the past five years in particular) is they have a particular agenda to push and if you aren't on the right side of their messaging they intend to suppress it by any means possible.
I don't think anyone truly understands their decision making process. It's above even the leadership. Scott Alexander mentioned this in a post this week:
> Right now there's religious pressure on tech companies to conform. Someone on Twitter pointed out that tech censoring Parler isn't a sign of their strength, but of their weakness. Imagine that Mark Zuckerberg decided he personally really disliked BLM, and he was going to censor BLM and any people/organizations/apps that promoted it from Facebook. Do you think he would succeed? Do you think he could stay CEO of Facebook after he was found to be doing this? Mark Zuckerberg and Big Tech in general are as much slaves to the prevailing religion as the rest of us; their "power" is the power to choose between medium vs. high levels of conformity.
[0] https://astralcodexten.substack.com/p/more-antifragile-diver...
Even after reaching that karma amount, you are only able to downvote comments within a day of their posting. After a day, only upvotes are possible.
Nothing proves you have a worthy argument better than outright hiding from dissent.
Again, they don't care if you stay on the platform. If they did, they wouldn't touch it. The disagreement buttons were added in the first place because they increase and maintain engagement. After a few decades it's now all the sudden a problem?
Ha! The real problem is their desired narratives are being soundly rejected and it's embarrassing. So here we are.
Why not? Even if you're right that they care more about propaganda than money, what's the point of propagandising to an empty room?
Dislikes are embarrassing to, for lack of better terminology, their pet causes. Simply disabling them on certain videos or channels calls even more attention to them - so why not just remove them entirely.
The only thing surprising to me is that it took them this long.
So hence why the whole feature is pRoBlEmAtIc and must be removed :p
They have like, love, care, haha, wow, sad, angry
Angry != disapprove because in the context of the other "emotions" it does not distinguish between disliking the post itself, or what it's referencing. If you post "Candidate X did Y" are you angry because the candidate did Y or because your friend posted something anti candidate X?
> Nothing proves you have a worthy argument better than outright hiding from dissent.
I don't know the general trends across YouTube or why they would do this. Certainly, they've also been silencing views they and certain influential groups advising them don't like, and I've seen videos put out by connected establishment and moneyed milieu downvoted into oblivion. But value and truth are not determined through popular vote. It might coincide, or it might not.
So the only way I can understand your comment is to suppose that downvoting of "preferred" YouTube content has gotten so severe that the company wishes to prevent the communication of exactly how much disapproval there really is for the "official narrative" (while potentially keeping track of it themselves) because once someone knows he's not alone in his disapproval, he might just have more confidence to resist or leave a comment that spreads a message unfavorable to them. So yes, dislikes might increase engagement, but it might not be the kind of engagement they want to facilitate.
This is exact reason. Go to you tube home page and every day there is bar of "official sources" news on coronavirus (clips from news stations). Here are first four for this day:
https://www.youtube.com/watch?v=USE5USAodiI
https://www.youtube.com/watch?v=n4kqSV1p3T8
https://www.youtube.com/watch?v=JmOL9ek7Tys
https://www.youtube.com/watch?v=4DpzcMZPTqA
Noticing here, each and every has more dislike than like.
https://www.youtube.com/watch?v=ynG4j-BsRhI https://www.youtube.com/watch?v=KBpYZnmPz3Q https://www.youtube.com/watch?v=16p2PcPgB5M
Personally, I upvote if I liked something, and I don't indicate anything if I didn't find it all that interesting or useful. Rarely if ever have I disliked something that youtube has recommended to me. The few times I have it's probably been because of some outside source noting it because it's objectionable. How useful of a signal is that to youtube or the creator? In that case it indicates what people that don't care about their content and aren't likely to watch any more of it think. That seems a poor source of feedback (and if we're talking about hat being useful to indicate to them that they shouldn't have done whatever they did, that's obviously served already by many other mechanisms, including comments).
The inability to downvote substantially alters what is said/ranked highly, I think.
Just tested. It makes a post to
/youtubei/v1/comment/perform_comment_action
with a parameter ?key and a payload containing "actions" both of which are long alphanumeric strings.I think Facebook could actually properly compete with YouTube if they wanted, it's just that their insistence that you have to be logged in to access content makes it much less appealing as a platform, because you can't just link people to videos easily.
...hence the ads? How would competitors be immune to the need to pay the bills?
It's not just the ads that are the problem with YouTube. It's also the way they can just demonetize anything that doesn't please advertisers, and the way their recommendation algorithm works. They don't even show me a lot of the videos from people I subscribed to on the app's homepage. Wtf?
It seems that most content creators are quite worried about the way YouTube handles (de-)monitization and copyright strikes. Many CCs are also streamers and use YT only as a side channel. Sure, YT still has a large footprint, but it's not as solid as it used to be.
Crappy videos could automatically be filtered out of their search and recommendations because people abandon them early. They may have determined that's enough to help user's find what they need.
It also helps the issue of dislike brigading since you won't be able to "dislike" a video at all.
Not sure if that's the right move or not but I don't think it's necessarily a bad one.
Yes they do. Watching 2 useless DIY videos and then a 3rd DIY video that finally helped you out, just kept you on the platform 3x longer than if you had filtered out the badly rated one and watched the helpful video first.
Checkmate. YouTube/Google/Alphabet Wins! 3x the ads. 3x the money. 3x the evil. Do not pass go, Google collects your $200. Time to hide the dislike counts... case closed.
courtesy of youtube: https://www.youtube.com/watch?v=bwcJNsoY50E
I'm curious what you mean by search being broken? Do you mean the quality of search results or something with search functionality. I ask because lately I've found the quality of certain search results to be increasingly disappointing. I'm not sure if that corresponds to some known change they've made recently though.
It makes me feel guilty to downvote someone or their work who's probably a good person, but it's the only reliable way to tune the AI. I get a lot of enjoyment out of music on youtube premium, but would stop using the service if they started airing ads on the pay service, or began serving music in such a way that I couldn't tune the suggestions and automatic play queues.
The YouTube community usually doesn't take downvotes as "not interested", but rather as an explicit expression of "this is crap".
It's clear that people is this discussion are focused on different types of videos, and the varied responses to the removal of downvotes reflect this. I'm focused on board game videos, which are the only videos I watch. A large number of downvotes on a board game video indicate that the video includes major rules mistakes. So when I see many downvotes, I simply play another video. I'm not going to bother performing a thorough investigation of the quality of one board game video that has a lot of downvotes.
[0]: https://phzoe.com/2021/01/27/white-house-youtube-dislike-man...
All that article shows is that the votes are manipulated by users too, there's no signal in down vote brigading like that
It's certainly possible that Youtube is acting in a political manner and is preferentially deleting real dislikes, but this post hardly proves that.
I didn't make that claim.
My main point is that the article suggests that this manipulation is selective, and while Youtube might indeed be selectively manipulating White House videos, the methodology used doesn't show that.
Here's a simple question which should be easy to answer, if you've actually approached this in an impartial way: does Youtube also remove likes or dislikes from other videos in a similar way? If the answer is "yes", then the conclusion becomes much less politically interesting.
PS, I think you're overestimating the amount of people who care about White House channel videos. E.g. the press briefing from 3/29/21 has less than 34,000 views. I guess some of the Trump rally attendees forgot to show up to their downvote party.
81m.org tracked other channels. Different behavior.
Youtubers have mentioned that up/down votes seem to have very little effect on video surfacing so I think Youtube has already figured out that folks are heavily biased in up/down voting and removed it from any algorithmic uses.
Comments on YouTube are bad enough. If you want to tell a video creator their work sucks, comments still work fine.
[0] https://www.youtube.com/watch?v=0f2D0GxCuBo
[1] https://www.youtube.com/c/JoeBiden/videosif the spin becomes "Biden wants it" without any proof, Biden videos will keep being downvoted only because those who oppose to him think he is censoring YouTube
But that's not what downvotes on YouTube should be used for
I am sure Biden as the President of the USA has the power to ask YouTube to reset the counters and call it a mistake, there would be no need to change the entire platform for everybody else
I'm pretty sure comments on DIY videos are more indicative of quality than downvote count
Most of the time I found it useless, I don't mind at all it gets removed.
Down votes only tell you someone decided to give a negative reaction. They don't tell you anything about why they did that. Using them as proxy evidence for your assumptions is dubious, especially on videos with small numbers of votes.
Often the reason why public dislike numbers are hidden is because people copy reactions - a visible count of down votes attracts more down votes. That doesn't tell you everyone who watched the video had rationally decided that the content is actually bad.
there is nothing more hostile to users than the fake information YouTube is providing
I would go as far as to remove the votes completely and sort the videos randomly
It's the same old story of HN downvotes
They happen randomly, sometimes users are targeted by bots that downvote everything they write and, most of all, if there is no way to know who downvoted you, the only way to survive it is to make a new account, because "moderators" don't care, their job is not to protect users, but to protect their employer.
Same goes for YouTube they are an ads company disguised as a UGC platform.
Advertisers and Premium subscribers are the real users.
Wanna really be user-friendly?
Show voters' ids!
We all know it will never happen.
Of course I received a couple downvotes, that rippled over my previous comments on completely unrelated topics, like this one, just because my other comments where more than 24 hours old and they couldn't be downvoted as per HN rules (the parent comment was already 15 hours old when received the only downvote - meaning nobody cared for it - at the same time of the btc thread that was fresh).
> You cannot downvote comments which are direct replies to your own comment, and you cannot downvote 24 hours after the original comment was made.
If downvotes where ided, it would be obvious that the downvotes on the comments on this thread were just retaliation from the frustrated owners of bitcoins whose propaganda was being questioned.
The id doesn't have to be the real useranme, it could be a random id that identifies a user for a brief period of time (48 hours) so that other users could report the issue, knowing that it's not their paranoia, but a real thing.
The Biden admin disabled comments on all official The White House channel videos pretty quickly into their administration.
Most videos have a tremendously high dislike to like ratio, the most recent is 3.4K dislikes to 205 likes. I don't know who they expect to consume their Youtube content but it apparently isn't the establishment's voter base.
This is another brick in the wall that is Youtube that just fell out if you ask me. Content creators of all stripes are absolutely desperate for an alternative platform.
Disney with the Gina Corano firing has been a huge source of continued embarrassment. Widespread rejection of woke takeovers of popular culture in general are problematic so no, I'm not surprised downvotes are getting remove universally. Much easier to hide reality when you pretend it doesn't exist.
Social media is a propaganda machine at this point. They don't give a crap about free expression. Too many plebs expressing their displeasure with propaganda can't be tolerated so here we go.
Reality is whatever one would like to believe. If you believe in dislikes as 'reality', then you would think most people in US would go rather die than doing so. I would not choose to have this dislike number fool me then, as I don't have need to remind that there are people who don't like you online.
What is not propaganda nowadays? If you have a twitter account, you are propaganda. Everyone is broadcasting some opinions here and there. As long as it is not removing dislikes just for some videos, this is a fair play, and nothing to do with free speech, whatever that means anyway.
The fact that they are removing the dislike count entirely instead shows me that the problem is not limited to a certain channel, or even a certain category. They are hiding that number on the entire website, because they are trying to solve a perceived problem that affects the entire website.
a few people getting together and disliking something and not seeing the dislike grow at all would turn that into an embarrassment.
> They are hiding that number on the entire website, because they are trying to solve a perceived problem that affects the entire website.
I agree. Negativity, dissent and open conflict don't sell ads to corporations well. Since that's Youtube's primary (only?) goal, it makes sense to switch video likes/dislikes to the same mode that comment likes/dislikes went. You can only express agreement in public, disagreement or quality issues can only be stated privately.
Not really. YouTube already fudges the like and dislike counters, based on their bot-detection algorithms, the eventually-consistent database that these counters are stored on, and stuff that’s already in place to defuse vote trains.
But -- is it a problem that you believe your viewpoint is widely supported, and I believe you are in the fringe minority, and vice versa? Should we be forced from our online/TV bubbles of choice? Obviously up/down votes are meaningless. Do we need regular referenda? Would online electronic voting work, or would everybody claim it was rigged?
Obviously, views aren't enough. There are multiple channels that get demonetized/de-platformed that have a lot of viewership but they don't fit in with the YouTube/Google agenda.
YouTube Rewind 2018: 19 Million dislikes
I don't see any reason you'd attribute removing dislikes to the former rather than the latter.
I'm not attributing to that, but I think the biggest threat Google is being broken up or regulated to death. And considering D control all branches of government, they're the party in power. So I don't think its unfathomable to think that a trillion dollar corporation would want to draw attention away from a small vocal minority of people that isn't happy with the president.
I'm not sure why you're expecting your viewers to be your reviewers.
Right: Cancel culture is bad!
Youtube: You're right, so we are removing downvotes!
Right: NOOOOO!!! I want to downvote Biden videos and cancel him!
It is a little silly. YouTube was removing the downvotes manually as "spam" anyway. Removing the button is just easier for them. The view count is much more telling. It seems like they'd have to pay out more ad money to artificially pump those numbers, so they don't do that.
>Content creators of all stripes are absolutely desperate for an alternative platform.
I'm working on something like this. If you have features you think are must have, please list them.
I think it's disingenuous to conflate negative feedback of any kind with 'cancel culture' (an overly broad and imprecise term, to be fair).
I don't agree. Many quality videos have low-no view counts because they are not promoted in any way or the persons making the video don't know how to do self-promotion. Downvotes are a signal about the percentage of people who watched something and disliked it, albeit an unreliable signal that can be gamed.
If it were just about view counts, th rational thing would be to get rid of upvotes as well and just let people rely on view and subscription #s and/or read the comments. As it is this will just lead to people putting thumb-down emoji in comments or flagging posts on other platforms that contain YouTube links.
I guess I just don't believe this. There's no gaming required. Youtube can and does adjust that number at will. It's not indicative of anything to me, anymore than a positive product review on Amazon is indicative of anything to me. Follower counts mean nothing. Likes mean nothing. I think most of us who write code here know the game is rigged in every way imaginable. Even if view counts went up, I wouldn't assume Biden is suddenly popular. I would simply assume Youtube decided to monetize the view count by selling them to creators for perceived clout or someone else did with bots, and I would probably be right. The angry voices on Twitter are there because that's Jack Dorsey's personal opinions and he amplifies them. If Jack was a Republican, it would be a non-stop Bible thump instead.
None of it is real to me. It's all imaginary numbers and GPT generated text blocks with thispersondoesnotexist.com profile pictures. I mean, it wasn't even a week ago where the media is running video with Biden's hand passing through reporter's microphones as he answered questions. Almost everything online and in the media is faked now.
It was a large and fuzzy microphone down and to his right.
https://www.reuters.com/article/idUSL1N2LH199
Alternate angle video (Note how low the two fuzzy mics are): https://www.washingtonpost.com/video/politics/biden-unveiled...
And I'm not pointing this out in an "Ackshually..." way. You're right about manipulation of truth in media. The problem is, even the people who think they understand that and see through it are being manipulated.
I've found the best way to spot propaganda around an incident is by asking, "What's the most boring explanation?" That's usually the truth.
Whether he's CGI Joe or not is just splitting hairs over the level of fake. The boring explanation is that the entire interaction was fake. The press had prepared questions that Biden knew. Biden had prepared answers the press knew. They're all just reading lines from a script. They might have even done more than one take to get it right. It is such a boring explanation that if I had incontrovertible proof of that being the case, the responses to it here would be something like, "Well of course it's fake! You really believed it was authentic? This is well documented in many presidencies. Look at FDR for example. Nothing burger."
I can't tell whether you're motivated by skepticism of Biden or politics in general, but you seem irrationally fixated on this, and we're now far away from talking about Youtube.
The response to that is people downvoting companies they no longer agree with on platforms like youtube. So what does youtube do? By removing the ability to downvote, they further strengthen cancel culture because the ability to display dissent is further decreased.
Can't question the election, can't question coronavirus. Big Google decides what is acceptable and keeps the rules and process vague, inscrutable, and opaque so they can selectively enforce them.
They won't have to deal with some top upvoted comment with: incorrect summary, incorrect restatement of something, abuse at the account or others, etc. For official announcement there's thousands of places to discuss them on the internet and literally no upside to allowing that in the same visible space as the announcement itself.
(see for example https://youtu.be/lzTUQLbzYJA and try to find any comment which provides any valuable information and isn't just heckling, totally off topic, or just abusive - I found just 1 out of ~140 - why would anyone want that on an official announcement?)
It's the same reason Trump wanted to be able to block people on Twitter. For the same reason he wasn't allowed to do that, the White House shouldn't be allowed to disable YouTube commenting. But hey, it's not like there's a double standard in favor of the Democrats and Biden.
That is completely different from not enabling comments on an announcement video where they're not enabled to anyone, but also not restricting anyone from seeing the content.
They have an option for that (technically, “only people you @mention,” but as long as you never @mention anyone, it won’t let them reply), but I don’t remember hearing anything one way or the other about him trying to do that.
Peertube exists
Thankfully, YT keeps doing user-hostile things, slowly pushing more people into trying out alternatives.
I know that’s a really esoteric example and I’m sorry.
Who, honestly, gets their news from YouTube? If there's someone pushing an agenda it's all the people on this thread who are extremely concerned with the (low) like counts on some videos, which most people don't know exist in the first place. 3.4k votes is nothing. I searched "Bach" and "This week" and this video from two days ago has 1.3k likes:
https://www.youtube.com/watch?v=G_sPYQj7uTU
3.4k likes is low for a YouTube video. WH videos don't get many views, either; view counts are in the tens of thousands, with a few poking up to around 200k. There's nobody even looking at the page to whom you could push a narrative, in theory.
Suppose there is a YouTube channel about how a minority in a certain country is discriminated against. Given what we know about discrimination, it is very unlikely for the majority to believe that it is discriminating this minority. Thus you have dissent and the possibility of hordes of angry down voters "brigading" that channel. These brigades may even be organized or supported by country in question because it doesn't like the negative views the channel is conveying.
If you said 2 + 2 = 5, I would disagree. This is a trivial example of dissent completely entangled with quality.
This is not how things are in my country (US). People make and post those videos pretty frequently. They get high up-to-down ratios, just like the videos expressing skepticism. Videos that seem to be downvoted the most seem to be ones with extremely "bad takes." For example, when one of the SpaceX Starship test vehicles exploded on landing, some cable news channel described it as some sort of embarrassing failure, when the thing was very clearly an unexpected success. That got a pretty serious number of downvotes. Of the remainder of downvoted videos, the only ones that seem to be consistently brigaded by users are ones where a creator dares to express an unpopular opinion with his audience, or the ones that are just pure corporate shilling and/or propaganda. The former are extremely courageous; the latter deserve to be downvoted to hell.
The YouTube algorithm being what it is, YouTube is already showing you videos that it thinks you want to see and will engage with. Brigading is thus pretty rare on the platform.
"Mainstream" and "majority" are not the same thing. The content and tone of established media is dictated by a very small minority whose basic material interests diverge from those of normal people.
I guess the question is what's worse: a mob's echo chamber or a cabal's echo chamber? It's been the latter for most of print/broadcast media's history, and I don't think it's done us much good.
What is a dislike in these instances actually communicating to youtube and to creators? Youtube already probably wouldn't have suggested that to you, and the creator probably isn't making content for you. As a useful signal, dislike brigading is very low (and whatever usefulness it serves in communicating to the creator is already served by comments and external media).
In that context, I think removing the indicator of how many people have disliked the video (but not the ability to dislike) may serve a useful purpose.
Indeed. Which means you'd have to watch the ads (oh, right, there's also a video involved) to determine that the content was garbage.
If you can tell without watching a video that it's trash, you might not watch it - which is opposed to YouTube's goal of increasing total video hours watched. Or, at least, their short term goal of making sure people watch stuff (I suspect the long term effects of making people watch more low grade nonsense won't show up in this quarter's growth numbers, which means it's Someone Else's Problem - get promoted and go do something else, it's the Google Way).
Despite all the claims from Google and YouTube about how they're trying to promote certain content and reduce exposure to others, it's a reasonable bet that their algorithms still don't understand much of anything about a video beyond "Oh, hey, people who watch this video watch more related videos later, so the more people I show it to, the more those people will watch, which increases hours watched!"
So, presumably, "dislikes" interfered with people watching more video. Remove the dislikes, problem solved. At least for their definition of "problem" and "solved."
Instead of trying to engage/change minds it's just easier to pretend "problems" like people having the temerity to call BS don't exist. Double plus good.
It's all about the money. ALL about the money. How do social companies make money? They sell ads.
How do you make more money selling ads? Either you show more ads (increase ad density, or increase eyeball-time-on-platform), or you make more money per ad (I used to see plenty of scam sites - new Kobota tractor for $1500, free shipping, domain registered last week - and far as I can tell, Facebook only cared that their credit card number was good).
More eyeball-time-on-platform requires "engaging" users more - weaponizing psychology, notifications, and A/B testing against them.
Facebook's guiding principles are simple: "What's Good For Zuck is Good For Zuck." The rest are no different.
BTW - there is no better driver of traffic (engagement) to something than a good like/dislike war. This has zero to do with money or they wouldn't be touching it.
No it is not. It only causes unnecessary frustration for content creators. Some of them may give up instead of trying again.
And for viewers, their recommender is likely already good enough to recommend good videos ignoring dislikes signal.
https://www.mediapost.com/publications/article/359823/former...
We were all supposed to love that movie because it has four women in it! Turns out a shit movie is a shit movie no matter how many SNL alums you throw at it.
I see this sarcastic quipping a couple orders of magnitude more often than I see the attitude it is skewering in regards to that movie (not that that attitude didn't exist). I think part of that is the normal overreaction to anything "SJW", but I think the bigger contribution might be because, after the incredible degree of hatred the black actress got, the reasonable backlash to that enhanced the perceived magnitude of the different-but-adjacent attitude you're criticizing.
I really don't recall Leslie Jones receiving as much backlash as certain outlets purported. Part of that is because that, for these outlets (common offenders including Slate and its ilk), any amount of backlash or derision, or frankly, anything less than glowing praise is "racism". And now that the word "racism" is starting to lose power, they've moved on to "white supremacy", but that's another topic...
I think you could be on to something, but the bulk of the backlash was because they butchered an absolute classic comedy that millions of people grew up watching (I myself have probably seen it over 50 times, my Mom said I watched it over and over as a kid).
I think with hot-button topics like this there's usually a race-to-the-bottom spiral of reaction and counter-reaction, with each side being fed the dumbest or most offensive arguments from the other side and reacting to them; then the other side sees a (likewise filtered for stupidity or outrageousness) selection of the responses and reacts to them, and so on.
Everyone is constantly escalating in response to the extreme fringe on the other side, while seeing a more representative sample of views from their own side -- which they are probably biased toward interpreting charitably, as well as no-true-Scotsmanning away the worst examples. So we're all constantly baffled by why the weirdos on the other side are overreacting so hard.
> Today in awful news, Leslie Jones’s personal website has been taken down after being targeted by a vicious hack. Hackers infiltrated the site with what appeared to be naked photos of the comedian, as well as images of her passport and driver’s license, private photos of her with various celebrities, and a photo of dead gorilla (and meme that refuses to die) Harambe. ... Last month, the comedian’s Twitter account was inundated with racist and sexist hate speech associated with her role in Paul Feig’s inexplicably controversial all-female Ghostbusters reboot, and Twitter pledged to reform their harassment policies in response.
https://www.thecut.com/2016/08/a-timeline-of-leslie-joness-h...
You can find screenshots of the trolls' tweets here: https://splinternews.com/how-a-racist-sexist-hate-mob-forced...
"Ok I have been called Apes, sent pics of their asses, even got a pic with semen on my face. I'm trying to figure out what human means. I'm out"
https://www.popbuzz.com/life/news/leslie-jones-racist-tweets...
Neither gender or race has anything to do with it being a lazy, uninspired and un-funny movie - but people are sure as hell desperate to use that as a shield from criticism :p
Almost the exact inverse like/dislike ratio.
Biden received more votes than any other presidential candidate in history, AND they should skew much younger than Trump voters. So why is it that the Biden White House channel struggles so much with likes vs dislikes?
Very stupid idea and apparently requested by the Biden admin. Now you have millions of Trump subs just disliking every video.
In the same way that Twitter seems to be full of anti-capitalist anarchist communists, demographics of the real world turn out to be a lot different than social media makes it seem.
- The hard way: Use YouTube's API to track the stats on one of the videos. Compare to my data, and the two will line up.
- The medium-hard way: Over the course of a day or so, simply compare the official likes/dislikes that you see on youtube.com to my stats at 81m.org. You will see that my stats line up with the official numbers.
It might be hard to believe at first, but I guarantee you that if you look into it, you will see that YouTube is deleting dislikes. There are tons of random threads about this on Twitter that are totally independent of my site 81m.org.
(edit: add newline between list items)
As another commenter mentioned, Biden inherited all of Trump's followers. Enough of them probably just downvote everything Biden posts, which one might call a very mild form of trolling.
I guess the theory is that Trump's followers are force-joined into subscribing to the Biden White House's videos. So then they react by downvoting every unsolicited video that pops into their streams. And the response is to delete their downvotes? So I guess the message to them is, "You really must look at what the Biden White House has to say. Oh, but you're not allowed to express your opinion about it."
Actually, you are allowed to click "dislike" and to feel like you expressed your opinion about each video, but later we will delete your opinion when you look away.
I made the site in question (81m .org). My inspiration was the work of Zoe Phin (whose name is phzoe on HN), who noticed that YouTube was deleting dislikes and decided to write some scripts and build some charts.
I replicated her approach and automated it further. The result is 81m .org.
If you want to validate my data, it is easy to do:
- Trivial way: For some video, check the official YouTube likes/dislikes/views numbers from time to time, and compare them to the numbers I display. You will see that they line up.
- Harder way: Get a YouTube API key, query `http s:// youtube.googleapis .com/youtube/v3/videos?part=statistics&id=<VIDEO_ID_HERE>&key=<API_KEY_HERE>`, and log the likes/dislikes/views for one or more videos. Compare to my data, and you will see that the two datasets line up.
You can find more info at 81m .org/about
(Sorry for the " .org" and " .com" and other whitespace insertions above. I am worried HN will shadowban me if I post links.)
Or, as YouTube stated, they removed fraudulent votes which is highly likely on a White House video.
BoardReader.com aims to replace this, but IME attempts to search for exact phrases (multiple words in quotes) doesn't work well.
I am skeptical about this design change fixing the stated concern, which is creator "well-being". If good faith creators can still see the dislike count, they will still feel miserable. Anyway, if you are putting yourself out there, other people taking a dump on you is part of the deal, because other people... you know, exist. If creator well-being is a concern, Google should focus on preventing or minimising actual harassment campaigns instead of these minimal design changes.
The design change also assumes that all creators are good faith actors whose well-being ought to be managed, which is impossibly idealistic. If there is a way for bad faith actors to benefit at the cost of good faith actors, they will exploit that, and the good faith actors will lose ground over the long term.
It also ignores that dislikes can be given for many reasons, hiding valuable screening information from the viewer. It should not be up to Google to hide this info and finesse their recommendation engine behind the scenes to serve relevant videos. Google would optimize for views, not the content in the video.
Submitters: "Please use the original title, unless it is misleading or linkbait; don't editorialize." https://news.ycombinator.com/newsguidelines.html
It sounds reasonable to imagine that dislike-bomb participants will lose the public shaming motivation if the dislike count is no longer visible; they also will lose the ability to practically organize eg by setting up goals ("10k dislikes and I'll give away xyz").
Creators still retain dislikes as a signal of quality from their audience. Viewers lose dislike count but it's also already taken into account into the recommendation algorithms that drive most consumption on YouTube so maybe not a whole lot is lost; besides in the only place where dislike count is shown, comments are already visible (and those may be negative too).
It's probably best to completely avoid all of it.
There is good stuff in there - don't get me wrong. It's just that the good stuff you want to find is often quite hidden, and I've on occasion spent more time trying to find some video that actually shows a tricky part of some bit of equipment maintenance than it would take to just do things the slow way (think "If you know the exact sequence of steps, you can slip the alternator out this hole between the engine and suspension - or you can just unbolt the exhaust and lower the alternator out that way" sort of tasks - if it takes longer to find a video with the steps clearly displayed than to just drop the exhaust, you've taken longer).
I've also found that YouTube leads to a very poor, surface understanding of most issues - and this isn't the fault of YouTube specifically, it's just a limit of video. If I want to learn about a new topic, I'll typically try to find three or so books on it and read those. A single book can have biases and misunderstandings, but by the time you've read a few, it's usually clear enough what the consensus is. Does it take more time than an hour or two video? Certainly. But I also get a far, far better understanding of the material (which, if it's an area I care to learn about, is probably useful) than I would through videos. Plus, I use an awful lot less data in the process.
I'm perfectly happy to be called a curmudgeon or such with regards to my preferences for text and images over video, and there may be part of it that's true - but I've weighed video versus the alternatives, and outside entertainment (which there's certainly some value in), I find video coming up wanting.
Also, books don't keep (buy this!) interrupting the content (buy that!) to feed me ads for (vote for this person because their opponent eats babies!) whatever happens to (watch this movie!) be paying the best rates (check out this new online bank and stock trading app!) at the moment.
I find myself watching zero mass-market television and a lot more YouTube (tech, electronics, machining, mostly) and think it a lot better value for entertainment time spent than TV ever was. (Sure, it's not as dense as reading a technical book, but after a day of work, I'm more up for the casual experience.)
I agree with your preference for books, but I am going to add a caveat: the quality of books varies considerably, with a good video being better than a mediocre book.
That was not much of a problem when I lived in a big city. It was easy to walk into a bookstore or library to pick out something of value. Living in a small city limits the options. Buying online means buying sight unseen. In the worse case, ratings can be misleading. In the best case, recommendations are likely coming from someone with different needs. YouTube avoids the problem since there is no financial risk involved in making a choice, and decent quality content isn't too hard to find.
(To give you an idea of what I mean: I live in a city of half a million people. The public library system's most advanced text on electronics is an old edition of the ARRL Handbook. The rest are projects books directed towards amateurs. Book sellers aren't much better since few want to stock technical titles. University libraries offer much better books, yet they are nearly impossible to borrow during the academic session.)
For anything IT related I usually dislike video guides as they're so slow to get to the point. But that's because I work in IT and don't need to be told that messing around with a disk partition could cause problems with my computer. With non-IT tasks I'm happy to be treated as a moron because I don't have anywhere near as much experience.
When you say "Use an awful lot less data" - is that still an issue most of the time? That's depressing.
I don't see a particular point in pulling down a few hundred megabytes that contains radically less actual useful content than a megabyte or two of compressed text and images. HN is particularly nice on that front, as the pages are tiny and gzip down to a rounding error (this reply page is a whopping 15kb of transfer). They don't load half a Windows 95 worth of tracking Javascript either.
Up until fairly recently, I had two rural WISP connections that mostly didn't meet rated speeds during the day, were borderline unusable during the evening (that Netflix can stream video tolerably on a lossy 1-2Mbit connection is quite impressive, the few times we tried it), and despite that have been working remotely full time on those connections.
I'd signed up for the Starlink beta some months back, and we have that as our secondary connection now (it's still exceedingly erratic - I'll go from 5Mbit to 150Mbit and back over the course of a minute and then it'll break my connections as there's no satellite overhead - but this is the point of a beta, and it's better than the 5/1 that mostly delivered about 3/0.5). I like it, but the power consumption on the dish is quite obscene. It idles a hair under 100W, and consumes 2.2kWh/day, per my measurements. I hope that improves over time.
It's not that I can't transfer a lot of data, it's just that I prefer not to when I can avoid it. And, there are, often enough, times when it simply won't work. Not a big deal, we live out here willingly, but, yes, it's still a thing. I keep a cheap cell plan too, because I just don't need to be streaming content on my phone.
For everything from waspkeeping to bookbinding, there's nothing else that can come close to the same semantic bandwidth as video does.
I've spent far more than half an hour reading blog posts on bookbinding, and still had to work out almost all the details for myself in terms of how to actually do it - not that I haven't found useful information in those posts! One linked here not long ago clued me in to a couple of tools I'd never yet heard of, and that in particular has been incredibly useful - because of it, I'm a lot closer to producing perfect-bound books indistinguishable in quality from those made professionally. But half an hour spent watching Adventures in Bookbinding - actively watching, skimming and reviewing where necessary, not just passively staring - has served me better in terms of the sheer mechanical doing of making books than all the blogs I've read put together. IT is one thing - I'm a software engineer, I get what you're saying - but when it comes to work you do with your hands, there really is no substitute for the chance to watch over the shoulder of someone who's mastered the skill.
(I don't actually keep wasps, although I've given it serious thought - the problem is that you really need to habituate them to your presence starting with the foundress's emergence from diapause, and I don't have any way to know where polistid foundresses spend their winters. But I'd never even imagined doing it before I found videos made by people who do it, and have done it for years. There's something of worth in that, too.)
Try watching TIK's BattleStorm Stalingrad series (link below). Exceptionally well-researched and the videos are information-dense. I own one of the books cited in his series, the 700-page "Armageddon in Stalingrad" by David Glantz. His video format communicates a fairly high understanding of the play of events, of the people involved, and other nuances, in less time than pouring over ALL of the source material would take. He mixes tactical/operational maps with dialogue bubbles of key commanders, tables of equipment readiness/casualties, quotes from people who fought there or from books, and lately he's been adding photos showing where on the battlefield they were taken. So a lot of it is book content (and many of the authors comment on his videos, praising his work), but he steps through the battle in almost real-time, and it provides a better view of scope, scale, and even decision-making by key leaders than digesting static maps in a book would. I would challenge the assertion that reading all of the books oneself would yield a significantly higher comprehension of the battle, and it certainly wouldn't be time-efficient to do so. Hence video as a communication medium is not inherently flawed. Like any other medium it is reliant upon exceptionally well-produced content. Most YT content isn't.
https://www.youtube.com/watch?v=YAfo5mse-ag&list=PLNSNgGzale...
Don't forget to like and subscribe and support me on patreon.
I wish there were more hybrid approaches, video with the accompanying wall of text.
He doesn't have one.
If it's a vehicle, the Chilton's or Haynes (I'm sure there's a difference but I sure couldn't tell) manuals will cover just about anything you'd want to do.
If it's a piece of consumer electronics, iFixit usually has good teardown and repair guides (in the "annotated images and text" style) that cover a lot, though for some brands you can actually find factory repair manuals.
Home, property, etc, there exist plenty of books out there, and often enough, plenty of slightly bored retired people who have been doing whatever the task is forever, and who are happy to help someone learn the ropes.
Or you want me to build a friendship with a retired fridge repairman? I don't understand that one.
With youtube I get to watch a pro do it right in front of me for free instantly. There's nothing like it.
ifixit is good, though, I'll agree to that.
As far as stuff like fridges... you don't need a fridge repairman, just someone who has worked on a variety of things. For a while, while I was doing laptop repair work, I didn't really need manuals for the bulk of the stuff I was taking apart because it was just a laptop. They all came apart in a handful of ways, and as long as you keep close track of where the screws came from and got them back where they went, it wasn't a big deal to get some random laptop apart.
If you can find a YouTube repair of your particular product, and the video is well done, OK, I can see value in that. My experience has been that it's usually a lot of mumbling, terrible light, and weird camera angles that I can't map to anything actually on the product I'm trying to repair, so it's generally not a good use of time vs just going and working on it. Shoving your cell phone kinda sorta in the engine bay, pointing it at some shadows, and "mmfffs the bolt... ffssssh" because it's windy out... eh? Or just a 45 minute "teardown" of a simple product that hasn't had any of the random futzing around and reading the manual out loud edited out.
Maybe we just fix different things.
Chilton and Haynes both generally consist of vague instructions like "unscrew bolts and remove part x". They're good for identifying which components need to be removed for access, but they often offer very little in terms of where bolts are (sometimes there are pictures), or how to deal with problem areas (e.g. sometimes you need to wiggle or turn things a certain way).
Their limited instructions don't compare to watching someone actually do it and walk you through problem points simultaneously.
My recent experience with iFixit was not great. I replaced a battery on a 2012 MacBook Pro Retina, and the tutorial included about 40 extraneous steps (that only mattered if you were using a certain, optional, glue removal goo -edit: and it was not referred to as optional, nor were alternatives offered. I used fishing line). I saw speculation that they intentionally made it seem more difficult so people would be more inclined to bring the laptop into a shop. It wasn't until I checked youtube, and saw a very similar procedure, that I realized the steps were unnecessary - via the comments! A few people noted that you could skip all the steps prior to 11 minutes in. And they were right.
Source: decades of working on my vehicles with Chiltons manuals.
Actually, the best and most effective way is to respond as consumers and vote with their dollars. Disney is a very profit centered and savvy company. If their profits on Star Wars and their streaming service drop off they will change their direction.
All signs point to people upset at Kathleen Kennedy as being a vocal minority. Disney is raking cash in on Star Wars and Lucasfilms in general and the population of Star Wars fans is growing. If #CancelDisneyPlus was a big deal then we'd see it in Disney's actual business moves, but it hasn't had an impact and downvoting on YouTube is probably similarly ineffective.
They can still use like/dislike metrics to decide which videos to offer you and in what sort order, so there's still some signal available.
Imagine if Youtube automatically showed unpopular videos in a permanently faded mode; this would be even more user-hostile.
Just give the users the count or ratio, and let them interpret (or ignore) it.
I'll grant that the actual count is still helpful data for users but the title is wrong and it's clear a lot of people never bothering clicking through.
(Edit: Boom, apparently this post was just flagged to page 2.)
For example, on a recent piece of Imperial propaganda [1] with 100K upvotes and 935 downvotes, we find the comment:
> 930 heretics and counting...
This one isn't laugh-out-loud funny, maybe raises a grin. Others are better. But it's a tiny artform which will be lost from the world.
In the top comment of the video jokingly said, “the 2 dislikes are from the teacher and her husband”.
Just a random screenshot cause haven't found anything else in Google https://i.imgur.com/3y8W2mk.png
You could see if a comment was highly engaging despite at the bottom, say 200/210 (upvotes/downvotes). Nowdays you only see the + or - number and that's all, only pushing that "meta" narrative that most people want to see.
Some of it is really weird. Like YouTube trying to get into streaming, but never actually implementing anything for it - no clips, no emotes really, but the weird "create a channel from your personal GMail account" thing is still there. It's like the people there were told nothing but a keyword.
i'm very fine with youtube *just working*
Ah, the first world, and our struggles...
IMHO the "like/dislike" mentality is partly responsible for the divisive hostility of culture today. You either like something or not, you're with us or against us, there's no middle ground.
Why has this relatively minor youtube feature change dredged up such significant vitriol and conspiracy-adjacent rhetoric in the hacker news comments?
Skimming all the comments here I'm seeing lots of flaming and hand-wringing. I don't have any actual measures, but to me it feels like significantly more than normal even for an article about a high-profile site/company.
This is the exact type of comment I'm talking about.
This does very little to contribute to discussion while simultaneously implying an undercurrent of conspiracy.
Why even bother pointing this out? It's extremely minor at most and the link is to twitter.com. It's not as if it would take long to read the link.
Just the second part of you comment: >They're removing the count of dislikes (which obviously has an impact) but the dislike feature itself is still there. would have sufficed.
Maybe I'm an atypical user but I would not call the like/dislike ratio "a huge part of the experience". I personally never look at it.
I have never seen a video which I thought "This is a bad video, nobody should watch this video" and had lots of dislikes. I don't think clicking that would even achieve its goal, clicking the dislike button is engagement and shows you cared about this content enough to do something.
So this change seems fine to me. Dislike will still exist, but now it won't cause a snowclone we didn't really need and it doesn't make numbers go up visibly.
Tangentially, I've often wanted a third button, call it "disinterested".
This would just tell YouTube not to recommend more of the same for me, without adjusting the ratio of votes up or down.
There are many videos I don't actively dislike (I might not have any strong feelings) I just don't want YouTube to recommend more cats with laugh tracks after I click a some link in our #random Slack channel.
Disliking such videos will drive users away from these videos, and hurt their profits. They likely ran a test already and deemed it worthwhile.
Maybe we could work harder on the root causes and worry less about people "kicking the dog" all over the internet because life simply isn't working across the entire planet for various reasons.
/Random thought from a random internet stranger
You can see the agenda pushing and manipulation on such films as Ghostbusters (2016).
Type in show boat videos and they show you a love boat video so you hit dislike. There was never anything wrong with the loveboat video, it was just shown to someone looking for something else.
Hate to be so cynical but watching what happened to reddit seeing some similarities here at youtube.
It’s almost like Google (and others) want to tell you which videos are good and should be watched and pretend to have user interaction.
TV 3.0
It seems that all types of user-interaction is getting prohibited...
No more critic, no more negativity, just kool aid and fake positivity as this is good for business when every one pretend to live in a fairy world...
Or do people's opinions count less if they are organized?
I think we need to separate the bot problem from the organic humans. BOTS should be the issue that is countered, regardless of whether they are upvoting or downvoting content. Humans expressing themselves is just grass-roots organizing.
Of course not, but the metric ceases to have meaning, so something important is lost.
Voting results being meaningful depends on a random sample of people who come across content, so that voters are approximately a random subset of viewers.
If voters organize, then they are no longer a random or representative subset, so the metric ceases to be representative of viewers as a whole, and becomes biased.
The ratio is meaningful.
The large majority of "productive"/"fair" video engagement is pretty much independent of the dislike *counts*.
It still matters to be able to dislike as a feedback function but they are not removing this (for now at least.).
Or maybe people can rate videos on a 3rd party service.
On occasion if the video is small enough of niche enough the comment section will have some useful content, but the vast majority of comments under any video seem to be just weird vitriol that is only ever tangentially related to the video.
The more things change...
They can still algorithmically bury things that are severely disliked, and promote things that are heavily liked. The video uploader, though, should be able to see the counts in order to get some feedback as to the quality of their videos.
Absolute numbers of likes/dislikes turns things into a popularity contest and fuels social media addiction. If you can only see the counts on your own content, you can't compare yourself to someone else and find yourself lacking (or vice versa).
I am curious __in a genuine way__ if someone who might consider themselves "woke left" (at the lack of a better word) here on HN who sees this as a positive development? (I.e., someone who views both aforementioned examples very positively)
Or actually, anyone regardless of political leaning for that matter?
Because personally I find it hard to construct even a simple argument for the viewpoint that hiding this information in any improves the website and/or society at large, with youtube being an important piece of infrastructure for the entire world right now. This instead would just seem like google continuing down their path of abandoning their "don't be evil" slogan.
Heat, kitchen, etc.
It's the money; probably Hollywood. Maybe the Whitehouse? If it's perceived as staving off a SV antitrust breakup a little longer but that just doesn't seem "big" enough of a concession. So I'm back to money.
What I'm a little more concerned about is the conspiracy-minded posters on this site coming out of the woodwork on this article who are about 6 parens away from saying what they really mean.
I have never participated in any change.org campaign for a similar reason: You cannot sign to oppose, so you end up with an extremely distorted view of a given matter.
It reminds me of the Uber approach to rating drivers - by Uber's metrics anything less than 5 stars indicates there was a problem with the ride.
There are riders who don't see it that way though, so for them, 3 stars is an average ride without problems.
I rarely look at likes and dislikes. For anything large, it's full of brigading.
Or if your fave content is only on Youtube, an alternative front-end such as Invidious
Also ranking-wise is a very strong signal to have
No... just me? K...
Yea... I remember when April Fools was actually funny. Like the wifi setup that ran through your toilets. That gave me a giggle back in the day. The PR stunt was to do a funny, absurd joke. Now it's just a marketing testing bed.
Damn clouds need to get off my lawn.
-Likes/Dislikes
-Only likes
-Only dislikes
I'd rather have only dislikes to filter content producer that can work past negativity.
https://knightcolumbia.org/documents/a07ecc2a26
Despite that, Youtube is trying to counter bad engagement. Several of Biden's content team's postings of youtube content have gotten tens of thousand of likes, but millions of dislikes resulting in a content "ratio". Downvoters have not been able to be discredited as bots or automated activity.
This isn't a general policy. It's a very specific damage control and political advocacy cloaked in a generic policy.
A correct summary would be: "YouTube experiments with removing public dislike counts"
If a video is misleading or fake, I think it should be reported and removed or marked as misleading and fake.
I see that my view is not popular, I’m open for debate.
That has not been the case for a good while.
doesn’t seem worth it though.
They've deleted a bunch of his dislikes in the past.
Sorry gentlemen, it's a reach. Crippling senility didn't stick, pedophilia didn't stick, whatever Hunter Biden's laptop was supposed to be didn't stick, and this... is getting kind of desperate. I know you're gearing up for 2024 but please, find some better memes. Quality over quantity.