Meta cuts Responsible Innovation Team
wsj.com
wsj.com
> its work was given prominence in the engineering operation by former Chief Technology Officer Michael Schroepfer, who announced last year that he was stepping down.
At the end of 2016, I joined Twitter to lead one of the anti-abuse engineering teams. My boss, who led the effort, was great: loved Twitter, hated abuse, very smart. 6 months later the CTO, who had been behind the creation of the anti-abuse engineering effort, left. My boss, previously gung ho, left in a way that made me think he was getting signals from his boss. And shortly after that, said boss's boss said that our team had succeeded so well that there was no need for us. He scattered the engineers, laid of the managers, me included, and declared victory. We all laughed bitterly.
What these have in common for me is a high-level executive launching a special team with great fanfare in a way that addresses a PR problem. But because PR problems are generally fleeting, as soon as do-goodery loses its executive sponsor, everybody goes right back to the short-term incentives, meaning things like "responsibility" go right out the door. At least beyond the level that will trigger another PR disaster.
And if you're wondering why you don't hear more about things like this, you're not supposed to. At least for the managers laid off, it was a surprise meeting and then getting walked out the door. In the surprise meeting, they offered a fair chunk of money (for me, $40k) to sign an additional NDA plus non-disparagement agreement. I happen to have a low burn rate and good savings, so I didn't sign. But I know plenty of people who have looked at the mortgage and kid expenses versus the sudden lack of income and eventually signed.
I get that with tech salaries 40k is practically a relocation fee, but I see those agreements as being about as binding as an EULA. I'd revel in them coming after me and can't for the life of me imagine damages past the 40k they offered unless you straight up lie.
Would they have come after me for anything I've said so far? Probably not. But probably isn't definitely. Even without signing it, I still have to measure every word against the odds I'll make somebody at Twitter mad enough to try to make an example of me. Signing would have made that much more fraught.
You're willing to sacrifice 40k to make comments on HN freely.
I'm not only willing, but would truly relish, even years fighting over some kitchen sieve of a anti-defamation contract in court. (all while the employer is forced to air out exactly what they tried to pay me off for mind you)
I'm not saying the latter approach is everyone's cup of tea, but I can definitely tell you which one I think is more likely to make an impact that hurts them...
$40k is a lot of money to some people, and not significant to others. To that person, being able to share the single post above might have more more value than an extra $40k in their savings account.
I wouldn’t sign that. Less, if I’m honest, out of any sense of duty, and more to maintain leverage. If that story is worth $40k to the firm it could be worth more to me, down the road, should my past employer and I find ourselves disagreeing.
It’s leverage held in reserve, not planned for immediate exploit. If we part ways and all is hunky dory, it sits stale. But if e.g. the firm gets bought by an asshole and he frivolously pursues ex employees for dumb reasons, e.g. deciding a non-compete covers everything from finance to gardening, I have something to fight back with. (One can similarly ask why the company needs non-disparagement protection.)
Employers and former employees get in stupid tiffs all the time.
It's the "if we end up disagreeing part" that seems like blackmail. And, hey, maybe that's what they're going for! Could say "yep, I want to be able to blackmail them if I need to." But the comment I replied to wasn't that explicit.
How is it blackmail if the company is the one offering the money?
For a few million dollars for a bounded period of time, sure, disconnect yourself from the Internet for that bounded period of time. For $40k, you're just taking on unnecessary problems that you don't actually have the resources to solve.
(I was offered $0 to sign an NDA after leaving my last job. I did not sign it.)
I read sagas about people getting doxxed every day, even children. You may trust your opsec, but it only takes one slip-up to be out a large quantity of money. I wouldn't risk it.
That silence was worth a lot to Twitter.
Totally agree. These agreements make sense. Just saying that if I were shown the door, I wouldn’t sign. (Different question if I’m asked while happily employed. Would be more inclined in that case, provided it only applied through the date of signing and if it were mutual.)
Example of buying silence is $7M settlement with security guy and even that apparently did not work.
And Twitter very clearly did not give a shit about "good feelings". Otherwise they wouldn't have done it for us as surprise meetings and security guards walking us out after, with salary ending that day. If you want good feelings, the way you do it is giving people paid time to find a new job. It would also have been nice to be able to finish up my work and tidy up loose ends. E.g., I had an employee whose annual review I was in the middle of doing. She was stellar and she deserved to be properly celebrated, rather than some rando manager come in and try to guess after the fact.
I can imagine answers, but I've never been in that situation. There are may be things I won't think of.
This is why I'm asking - my first instinct is take the money so I'd like to fully understand the thinking of the opposite side.
In any case thanks for replying.
Additionally, the belief in one's own moral choices and behavior is often one of the important steps in finding fulfillment in yourself. If your fulfillment is reliant on external validation, you will always be found wanting.
Don't see many pitchforks...
For me it's pretty dang high. Like on the order of 5-20 million USD in the bank. At some point I'm going to stop working. Rent and life expenses where I live currently are probably $100k a year (yes I could live on less or move, but that's part of the point).
Let's say I stop working at 65 and I live to 85. That means I need at least 2 million dollars in the bank to keep spending $100k a year and it assumes I die at 85. If I happen to live to 95 or 105 I'd be S.O.L. Also add in escalting medical expenses, inflation, other issues and 5 million in the bank is IMO the minimum I'd need to feel I could discard other money and stop worrying about it.
And that assumes I stop working at 65. If I was trying to stop earlier that would go up. I get at some I could theoretically live off the interest.
My point is, at least for me
> a certain amount of money to cover life expenses + recreation, additional money has diminishing returns.
Is generally false. It's usually part of the "if you make $75k a year, more won't make you happier" but IMO that's not true because I'm screwed if that $75k a year stops.
Also, source of that point is often misquoted. It says happiness doesn't increase with more money. But life satisfaction does increase forever with more money. Here's an article pointing out the original study did say satisfaction increased as well as a new study that says happiness increase too.
https://www.forbes.com/sites/alexledsom/2021/02/07/new-study...
If I had even more money I'd angel invest. I think that would be pretty fulfilling. If I had even more money there's all kinds of projects I'd like to fund. I expect I'd be pretty proud to fund them.
It's not like we're talking about killing babies. Where' talking about signing an NDA or in my case not being 100% on board with a company's behavior in ways that are arguably ambiguous. As an example, if I had New York Times stock and was upset at their hypocrosy of complaining about ad supported companies while themselves being an ad supported company. Whether ads on NYT are good or bad is an debatable point. The point being, nothing the company who's stock I was holding was unambigously evil. But I chose my conscience over arguably trivial issues. In this particular case I think it was a mistake. If the company had been truely evil (by my definition of evil) then I'd be more okay with my decision.
By that logic we all (er, at least most of us) turned down $100mm by not throwing $1k into bitcoin at the right time...
More money has exponentially increasing returns. Other things don’t increase in intrinsic importance, being wealthy just frees one to focus on them.
If you're a minion, then you just build the volcano headquarters and the atomic missiles because, hey, it's your job. They don't pay you to think. Your job is to make your boss look good. You give 110% and think outside the box only when it's firmly inside the box of the primate dominance hierarchy you are embedded in.
Professionals, though, explicitly recognize they are part of a society. They owe something to the client/employer, but also to the public and the profession. For example, read through the preamble here: https://ethics.acm.org/code-of-ethics/software-engineering-c...
I see myself as a professional. I sell my labor, not my ethics. So what I would have lost by selling my ability to speak out about a problem? My integrity. My independence. My freedom. $40k is a lot of money, but it wasn't worth 40 years of shutting up about anything Twitter would want me to keep quiet about.
Thank you, seriously.
Thanks also for explicitly spelling out what it means to be a professional. (duty to profession and society as well as employer, written source, summary "sell my labor not my ethics")
Why?
> The foundational qualifications of an engineer typically include a four-year bachelor's degree in an engineering discipline, or in some jurisdictions, a master's degree in an engineering discipline plus four to six years of peer-reviewed professional practice (culminating in a project report or thesis) and passage of engineering board examinations. A professional Engineer is typically, is a person registered under an Engineering Council which is widely accepted.
Personally, I mostly refer to myself as a developer, not an engineer. Funnily, my great-grandfather came to America to work as an "engineer" in the Minnesota mines back when the standards for "engineer" were much looser. I imagine we'll have a similar process in the coming decades, where some sorts of software engineer will be licensed, and that you won't be able to call yourself by that term without getting into trouble.
For a very brief moment in time, some jurisdictions fought against the use of the title. In Canada Engineer is a protected title (like CPA) and they tried to hold Software Engineer to the same professional standards as other engineers (civil engineer, mechanical engineer, chemical engineer, etc...). This meant having a degree, working under a Professional Engineer for some period of time, then passing an exam demonstrating expertise and high ethical standards. I don't remember all the details, but I think Microsoft fought this and today Software Engineer doesn't imply anything in Canada.
If Software Engineer were a real profession, then you could be sued for malpractice and lose your ability to work in the field. It would also mean you have real power to push back against employers asking you to do illegal or unethical things. You would have personal liability and wouldn't be able to claim you were just following orders.
https://engineerscanada.ca/become-an-engineer/use-of-profess...
I have never heard of anyone having to “work under a professional” for some time after taking their degree.
https://en.wikipedia.org/wiki/European_Engineer
If you are talking about software engineer, then no you wouldn't have heard of that. You can't get a EUR ING designation as a software engineer (AFAIK).
Academic study just isn't sufficient to understand modern software development. One of the hallmarks of academia is how short-lived everything is. But many of the interesting issues in software development only become visible on long-lived projects. As a hiring manager, I consider fresh-out-of-school developers to be dangerous until proven otherwise.
I don't yet think software development is stable enough to turn it into proper engineering. But if it were, what I'd be looking for is a relatively high standard that includes both exams and a few thousand hours of supervised practical experience, similar to what they require of electricians or therapists.
I borrowed this from the way quite a few lawyers work. Its served me well and garnered quite a bit of good will over the years, but at the end of the day I do it primarily because I sleep better knowing I’m not ripping people off and taking advantage of them.
Ethics is not just a box you tick
There are other perspectives, though. Here's a starting point for one of the big categories of thinking that might lead one to turn down $40K essentially just on principle:
For what it's worth, I'm at root a consequentialist, but see virtue framings as cognitively much more tractable given both the weird feedback loops of one's own psychology and the immense computational cost of trying to predict consequences over coming decades.
Edit: To be clear I didn’t say this to shame the OP. I said this to highlight that the company didn’t offer up much. I say this because I have been in a similar position in the past where their “generous” offer was two months severance (same ballpark) which imo was insulting. Didn’t sign it either and told them to F off.
k
40k is a lot of money.
One day I hope to see giving up 40 grand as a viable option
1. International Speak Like a Pirate Day.
2. Passing by John Cook without an R-R-R-R me hearties!
Ahhh me mateys !
IR, matey
It highlights just how out of control the wealth gap is becoming.
Taking a public company vs average employee as a wealth gap example is probably not showing what you want to show.
The 40k isn't a gift, it's a payment in order to take on a liability. I'd have a lot more success not talking about why I was let go, as opposed to not saying the word "are", but I'd still have to weigh the consequences of messing up one drunken or tired evening.
Even with 20k bring home salary (which means you have been around a bit, possibly having family, mortgage, other investments, have hobbies that are a bit above just breathing air costs, teavel etc) you are saving just a fraction of that.
For some the fraction is really tiny, for some a bit bigger. 40k (just raw amount, untaxed) can be a year's worth of actual savings easily, even with good job.
Kudos to OP, bits like this keep my faith in humanity.
I have seen it tried in a situation where a manager called an employee a racial slur. The employee sued and the company settled. Too bad for the company the employee had an email where the racial slur was used. You may not hear about it because it is kept hush hush in Silicon Valley.
Something similar happened to me. A manager said that a certain gender wasn't liked around here. When they laid me off, they gave me an unusually generous package and asked for a signature.
The discussion can start from the point of view of wanting the laid off employees to have a soft landing, and the lawyers push for especially non-disparagement and tightening up NDA.
That's an option I definitely considered, even discussed. But for reasons I mentioned elsewhere I decided to not sign, and have instead since mainly worked for non-for-profits at lower rates. So if we can count the salary difference as giving to charity, I've already given far more than that.
FAANG pays that to new grads. (500k stock over 4 years and 140k salary is pretty standard).
I've worked at places also where 105b-1 plans were generally available (sell all shares at vest even outside trading windows), in which case employees were absolutely receiving 40k+ liquid cash a month. Many senior engineers were receiving substantial more than that.
Rsu is the largest part of comp for a senior person so more that half. So add another 300 k on top of that.
That’s a comp of close to 600k a year or 50k a month when averaged out.
I mean, I just joined joined a new job two months ago in a full remote position for 50k Eur/year, working in France. It's already almost 10k more than my previous job.
I read that the median annual wage in 2021 in the US was $45,760. In France, it was 22,184 euros in 2018.
So I guess, $40k is a joke for some, but would make a large difference for most people out there.
Not (necessarily) getting down on OP, but the sort of person who's attracted to anything that Twitter would call "anti-abuse" might not be the sort of person who's appropriate in any other role.
And I get the Machiavellian calculus. I cared about Twitter and its users, especially the marginalized ones that were facing a lot of abuse. He cared about his own career, and wanted people who would put his advancement first. I would not have done that, so pushing out me and anybody else who really cared about the problem was the correct move in his self-centered analysis.
But if I had to guess, top of my list would be faster, more targeted action to deplatform shitheels. For a while last year I was tracking a ring of nazi-ish jerks who managed to stay around eternally by getting new accounts. They'd either circulate the new account before the old one got banned or come back, follow a few people in the account cluster, and then say the were looking for their "frens", which would prompt a wave of retweets in the cluster so as to rebuild their follow graph.
I'd also look for ways to interfere with off-Twitter organization of harassment of particular accounts, which has some characteristic signals. Interfere both by defanging the content (attenuated notifications, downranking) and faster suspension/banning for jerks that are part of the waves.
I'd also love to see more support on the recipient side, but I haven't kept up with what those tools look like these days.
That said, I believe they've made progress since I left; I think twitter has a notably lower proportion of shitty behavior than years ago. So kudos to whoever's been working on this problem across the reorgs that have happened since I left.
You seem all in on the idea that Twitter should be stamping out nasty speech, and I can certainly respect that philosophy for a private company. I certainly wouldn't want to personally work to support the aforementioned shitheels. But I'm curious what you think of the broader ethics that people often bring up in these discussions. Is it bad that the contemporary "public square" is dominated by private companies that get to determine the rules? Should there be a real digital public square that isn't dominated by private companies? Could such a thing even work?
I dunno, maybe you're tired of this so uninterested in writing such a thing, but I feel like so many people act like the answers to this stuff are both obvious and easy to implement, and I know that's not true, and would be interested in the view from the front lines.
There is a real digital public square: the internet. Anybody can publish anything. Anybody, private companies included, can help people publish. But all of those people have freedom of association. Nobody has to use a particular publisher, and none of those publishers have to publish anything they don't want to.
Many popular platforms have started out with a "free speech wing of the free speech party" ethos. I was part of one of those, bianca.com, which won a webby in 1997 and was gone by 2000. The lesson of every one of those, ours included, is that you can't have all the kinds of speech in one place. E.g., Twitter can have black people or people who shout abuse at black people. So the question for any platform is: who are you ok excluding?
This is not a new lesson: https://twitter.com/IamRageSparkle/status/128089253502461952...
I think it only feels new in the digital context because people often start from a assume-spherical-cows perspective. Which can be adequate if you're building an ecommerce system or something. But when building tools to shift society online, it's hopelessly naive. So I'd be interested to read a "real digital public square" proposal that started from actual human behaviors. Say, people who studied physical public squares, their impacts, how they're regulated, and the social, non-legal mechanisms that keep them from just being filled with nazis, spam, and porn. But the ones that come out of the same naivete that we had in the mid-1990s or that Jack and Zuck had a decade later? We know what happens, and it never works out well.
- Social networks can be blamed for basically any evil that happens in the world. You express elsewhere the belief that Facebook can be blamed for the Rohingya Genocide. And thus by definition that your colleagues and past/future work mates could also be held morally responsible for genocide or more or less anything bad, via the transitive property of whatever. This belief requires sloppy and motivated reasoning to sustain.
- That perhaps your job was to ban anyone you regarded as "shitheels", "jerks" or "Nazi-ish" (!). In other words anyone whose views you simply didn't like. That's not an anti-abuse policy worth of the name.
With these attitudes it is easy to believe that the team you were on was not only highly disruptive towards colleagues and users but ineffective and a legal liability as well.
Except that you are not a very good reader, because I explicitly didn't say "Facebook can be blamed". Sorry, but you're not tall enough to ride this ride. Come back when you've grown up some.
"Facebook has a body count"
and when someone responded blaming Facebook for an actual genocide you replied with:
"Yeah, when I say that Facebook has a body count, I'm not kidding"
Then when someone else disagreed with you, stating that "the entire (read 100%) responsibility for the Rohingya Genocide or other similar events [lies with] the perpetrators" you doubled down by saying:
"Facebook is morally responsible for that harm"
and proceeded to argue that their "barest minimum" standard should be to ask, "Hey, is there a way to be sure this next feature is responsible for zero deaths?"
You very clearly argued that in fact Facebook can be blamed for, well, god knows what. Genocide and "body counts" at minimum but it's pretty clear that you think almost anything can be blamed on a social network or other communication providers, given that basically all organized human activity involves technology-mediated communication at some point.
And now you're trying to claim you never said Facebook can be blamed! If you didn't really mean that then you need to learn to better express yourself, because a whole lot of people in that thread interpreted it in that exact way and you proceeded to respond without correcting them, indeed, by telling them why their views would lead to more airline accidents (!). Ye gods, you must have been a serious liability problem waiting to happen with these attitudes. Imagine lawyers bringing up your views in discovery and then saying, Twitter's own staff definitely believe Twitter can and should be blamed for ${litigants harm} by their own arguments. Case closed, your honor.
Failing that, squelch viral content (slow it down).
Ban 'likes' and so forth.
Treat all personal data as property of that person. Transmuting demographic data from an asset into a liability.
FWIW, here's my prior answer to your question, citing the reform efforts of US Sen Warner's SAFE TECH Act and Information & Democracy's Policy Framework:
OP was pretty explicit that his job was not banning spambots, but "protecting marginalized users who face a lot of abuse".
Also, Twitter ships anti-abuse features all the time so they seem to care about it. Although they're not especially strong, like the one that asks you to reconsider if your tweet has too many swear words.
Or any other hiring managers anywhere else - I'd be really hesitant.
- "Pump and dump."
- "Savior to villain."
I see this pattern frequently - with corporations' power and influence, their ethics go checked only by law and public sentiment..
I appreciate your $40k comment here!
I'm glad to hear you learned your lesson!
There are so many of us who can relate. Huge kudos to you for your integrity and for staying humble.
Thank you so much for being humble about your skills. I wish more of us took this perspective
This is infuriating. The boss’s boss knew this wasn’t true. You knew it wasn’t true. Why lie? Especially with such an obvious and unconvincing lie? Twitter is so addicted to misinformation they’re even spreading it internally and off-platform.
Which is what happens all the time in power hierarchies. Some people enjoy that bad thing are happening, more are indifferent, and most of the rest are kept too busy to really think about it. Or too distant from power for any thinking to lead to action. E.g., America's history with slavery.
But yes, if you are paying attention, it's fucking infuriating.
I wonder if there is room for a tool which tracked the rate at which users interact with negative or psychologically high risk content on a user generated site.
> At least for the managers laid off, it was a surprise meeting and then getting walked out the door.
I don't get it. Call me naive, but when a team is dismantled because of change in business priorities, people don't get fired. Unless the company is shrinking, valuable employees are reassigned to different teams.
This really depends on the change in priorities and skillet the people represent. People aren't actually fungible, after all.
Even the CEO can be replaced with another key employee.
So i think parent is onto something with comment. And I think that's also the elephant in the room that no one talks about.
Why did this specific set of employees end up working in said team?
People are getting hung up on the dollar figure in replies here, which I think misses the point.
It's super common for companies to tie a severance package (assuming more than statutory requirement, ymmv with jurisdiction) to a non-disclosure, non-disparagement, non-compete that is often far more aggressive than whatever you signed at the beginning. It's definitely worth thinking about whether or not the agreement makes sense to you.
This is one of the big differences with executive contracts; often all of this is already sorted out at time of hire, and everyone is pretty much open eyed about the failure modes.
In 2014, for most divisions, the SDET role was rolled into the function of SDEs, reportedly resulting in drastic attrition of the converted SDETs. The exception was the operating systems division, which was reported to have laid off all of its SDETs at that time.
Turns out many kinds of businesses/product teams (including Microsoft's Windows team, I'd say, from personal user experience) need dedicated QA people because many worthwhile tests can't really be automated well enough with a reasonable effort, or if they can, it's something that often breaks and needs regular maintenance.
I suspect that in the Windows case they simply stopped testing those troublesome cases.
If you asked engineers to do a large amount of manual testing, they would either (a) tell you they were and then secretly automate it, (b) simply not do it, or (c) quit.
The bad security teams just show up and expect to say criticize everything and stop other teams without providing workable alternatives.
The problem with having a team with a vague charter (“responsible innovation”) with unclear scope (e.g. not just security or just privacy) is that it’s really hard for them to feel like they’re building foundations for others to build upon. It’s too easy for them to fall back to roles where they see themselves as the gatekeepers and therefore backseat drivers of other teams. It becomes a back door for people to insert themselves into power structures because nobody is entirely sure where their charter begins and where it ends.
We can talk about whether this particular team is effective. We can talk about unclear scope (though, IMO, the scope here is no less clear than "privacy"). But the complaint that teams that put barriers in front of other teams are always bad is insufficient at best and downright dangerous at worst.
Nobody made that complaint.
Please don't misrepresent my statement, which was specifically, "to justify your own existence, you have to put blockers in front of people who are actually trying to build things."
Good security teams build & they help others build as well. They build secure-by-default platforms, secure common libraries, and guidelines for others to follow with confidence. Working with a good security team means you're confident your product will get to market faster because, at launch time, you know you'll be green-lit since you followed the org's security best practices.
That kind of team doesn't have to invent blockers in order to justify its own existence.
Definitely helps you make your point.
You admit that teams in this space can and do often build tools to make things secure by default or private by default, so why couldn't this team be involved inbuilding "responsible" by default?
Your argument here is basically that you believe security and privacy "blockers" are inherently of value, so a team enforcing them isn't 'inventing' blocks, but other teams are.
"Responsible Innovation" is kind of nebulous and I would expect it to be problematic unless given clear rules of engagement and supplied with a strong leader.
That said, somebody needs to be responsible for dealing with the endless stream of products that are deeply flawed out of the box: builtin racism, builtin stalking/harassment tools, "0-day" doxing of existing users ...
Thing is, any way Twitter can innovate in a way that would bring income is likely unethical. Either it will try to increase engagement by polarizing people - increasing heat; selling user data; showing advertising or additional worse things.
The difference between these things and something like a "Responsible Innovation Team" is that the goals of the latter are often poorly defined and amorphous. What does "Responsible Innovation" really even mean? But contrast that with, for example, security goals, which are primarily "don't get breached". Security folks, privacy folks and accessibility folks should all have a very well-defined job to do. For the other "PR-focused" teams, they usually have to make work up to justify their jobs.
Note that, obviously, it's also possible to have bad security people, for example, who only see their job as to throw up roadblocks and demand that your security checklist is ever-growing. I'd even say these are the majority of "security" people. But the good security people who are able to integrate themselves successfully into your product development processes are worth their weight in gold.
Also IME none of these things are binaries -- a product could be more or less secure, privacy-respecting, and accessible, just as it could be seeking to innovate more or less responsibly. Different aspects of security, privacy, accessibility, and responsible innovation will be important at different times, depending on what's happening in the world.
The jobs are never as well-defined as you'd imagine.
- should we do this?
- who do we hurt by doing this?
- oh god people are hurting why are we still doing this?
However if we're critizing from purely a moral standpoint, how is this any different than claiming that cell phone carriers should be preventing this type of thing over phone calls or texts?
For the record, I don't find that to be a convincing argument either but it's the inconsistency of perspective that irks me.
> [getting] the Facebook dating team’s ... to avoid including a filter that would let users target or exclude potential love interests of a particular race
you see, you have to just ignore those people in the feed, you can't filter them, its better and not racist that way. and who knows, you might become not racist if you see a pretty girl/boy you like, but actually that's probably just racist fetishizing
responsible innovation is doing the same dei doublespeak
It would be nice, but would require an inside person to dare make potentially traceable (by their contents alone) public comments so it's unlikely, to know what the team actually tried to do, did do, and what it achieved. Without actual facts the discussion will just end up a free-for-all.
We of course don't know enough of the specifics, because Facebook works hard to keep it that way. But we do know that Facebook has a body count. If you're looking for a "valuable entry point for discussion", maybe start with Facebook's well-documented harms.
Seeing devs non-ironically complain about internal departments like this one which was set up in order not to let that happen again kind of saddens me a lot. No, productivity and work is not more important than making sure that that work doesn’t enable a genocide campaign in a specific corner of the world.
In the context of ensuring a bank doesn't transfer money to terrorists, this is completely wrong. Banks have a whole list of operations and processes, and failing this is enforced by actual jail time. This is why "know your customer" exists in banking. In the context of terrorism, there is no police enforcement regarding terrorists; often, we are talking military enforcement.
This is also incorrect. Transferring money to a terrorist organization is a crime because countries have declared it illegal. Of course well-funded terrorists have victims and enablement of well-funded terrorism has clear victims.
And yes, the government is using military and diplomatic channels to fight terrorism directly-- by ensuring the resources they have access to are limited.
One is that you think a lot of things just shouldn't be enforced, and that we should allow a lot more harm than we do now. Genocide?
The other is that you think we should have a lot more police to take over the harm-reducing regulatory actions now in place. That we should take the tens, maybe hundreds of thousands of social media moderators now working, but make them government employees and give them guns.
I can't decide which is more cartoonishly evil.
Social media moderators exist to protect the public image of the platform, and enforce community guidelines. They should not be burdened with law enforcement simply because we can't be arsed to do proper police work.
Facebook is not like a screwdriver, a simple, neutral tool that is occasionally used to harm. Facebook is an incredibly complex tool for connecting humans, a tool with all sorts of biases that shape the nature and velocity of social interaction.
People have known for decades that online communication systems enable harm. This was a well-understood fact long before Facebook existed. Facebook is morally responsible for that harm (as are the perps, etc, etc). Something they understand perfectly well because they do a lot to mitigate that harm while crowing about how socially responsible they are being.
You might disagree with most ethicists on this, as well as with Facebook itself. But you'll have an uphill struggle. Even the example you pick, vehicles, doesn't work, because car manufacturers have spent decades working to mitigate opportunities for the tools they create to cause harm. Now that cars are getting smarter, that harm reduction will include preventing drivers from running the cars into people.
The only way to objectively agree about responsibility is to use an actor/agent model, where actors are entirely responsible for their actions, and only actions which directly harm others are considered. Otherwise we're discussing which butterflies are responsible for which hurricanes. I'm happy to be wrong here, but I just don't see an alternative framework that can realistically, objectively, draw actionable boundaries around responsibility for action. This by the way is the model that is used in common law.
Facebook being a complex tool strengthens my point. Should providers of complex tools be responsible for every possible use of them? Is it not possible to provide a complex tool "as is" without warranty? Wouldn't constraining tool makers in this way be fundamentally harmful?
> online communication systems enable harm... Facebook is morally responsible for that harm
Everything can be seen to "enable harm". Facebook being morally responsible is not a statement of fact, it's an opinion. Facebook's actions to mitigate are a) to evade/delay regulatory action, b) to maintain their public image or c) by a small group of activist employees. Only a) and b) align with their fiduciary duty to shareholders.
That's incorrect. I'd suggest you start with Dekker's "Field Guide to 'Human Error", which looks at airplane safety. Airplanes are only as safe as they are because many different people and groups see themselves as responsible. Your supposedly "objective" model, if followed, would drastically increase deaths.
The reason airplanes are safe is because the government is doing its job to regulate the space.
[1] https://en.wikipedia.org/wiki/List_of_accidents_and_incident...
I'm not saying the NTSB isn't important. But it's far from the only reason that we have fewer crashes. Government regulation can be helpful in improving standards, but they set a minimum bar. Aviation's high levels of current safety are a collaboration between many, many people. Starting with individual pilots, engineers, and maintenance techs, going up through collaborative relationships, through companies and civil society organizations, and up through national and international regulatory agencies. All of these people are taking responsibility for safety.
If so, how do you explain the catastrophic failures in construction, food safety, and banking prior to the top-down government oversight of those industries?
They serve two different purposes. The former comes out of a zero-sum, adversarial setting where the goal is to figure out who pays for a past harm. The latter comes from a positive-sum collaborative setting where everybody is trying to improve future outcomes.
If I release a new product tomorrow, I'm responsible for what happens. As are the people who use it. But if somebody dies, then liability may be allocated only to one of us or to both in some proportion.
Again, read Dekker.
"morally responsible" ~= "guilty"
But you are still imho (morally) responsible for the deaths occurring out of the use of your product (this is where we would probably disagree). Even if you were not legally guilty.
I like another example that to me clarified the distinction between these concepts better.
Imagine one morning, you open your front door and find a baby having been placed there somewhen during the night. The child is still alive. You are not guilty in any way for the baby's fate, but now that you have seen it you are responsible for ensuring that it gets help. You would be guilty if you would allow it to freeze to death or similar.
This significantly varies by jurisdiction, and isn't settled at all. I don't think being present makes you responsible either. Unappealing as it may seem, you should indeed be able to pull up a chair, have some popcorn, and watch the baby freeze. People should only bear obligations they explicitly consented to. I don't think anyone has the moral authority to impose such an involuntary obligation on anyone else.
Modelling society as a constrained adversarial relationship between fundamentally opposed and competing groups is more accurate than assuming there is "one team" that knows a fundamental "good" or "right" and that the rest of us just need to "see it". People who perform honour killing or preside over slavery are just as sure of their moral superiority as you are. What we need is a world where we can coexist peacefully, not one where we are all united under one religion of moral correctness.
But they wanted to be valued higher, so they explicitly chose to instead step into the editor's role and became responsible for the content on the platform.
What makes you think this possible? I don't see where Facebook is particularly responsible here. Telephones and radios have been used to coordinate assassinations and genocides. Movies have been used to justify invasions. Why isn't anyone burning the effigies of Alexander Graham Bell, Guglielmo Marconi, and Thomas Edison?
In any case, perfection is rarely possible but often an excellent goal to aim for. For example, consider child car fatalities. We might not immediately get it to zero, but that is no reason to say, "Fuck it, they can always have more kids."
edit: I'm sorry, we do get to discuss how they were probably wrecker nutcases stifling people who actually build things in order to make up for their own inadequacies and inability to do the same. It's only assuming that the ethics team worked on ethics that is out of bounds.
Many people are taking it for granted that Facebook should have no interest in reducing harm. I'm glad somebody pushed back on that.
The problem is trying to get people that think everything you listed is obvious and boring to spend 40 hours a week staying out of the way 99% of the time, but also being politically savvy enough to get a few CxO’s fired each year.
Also, since the office is normally doing nothing (unless the office has already completely failed), the people in it need to do all of that, and continuously justify their department’s existence when their quarterly status updates range from “did nothing” to “cut revenue by 5% but potentially avoided congressional hearings 5 years from now” to the career-killing “tattled to the board and tried to get the CEO fired”.
If you know how to hire zero-drama, product- and profit-focused people that can effectively do that sort of thing, consider a job as an executive recruiter.
You can guarantee no harm by doing nothing but that's not a good enough answer.
- should we name this device we want to put in every house after one of the most common American female names?!
engineers and ceo: I see no issue with that!
Several millions people named Alexa now have everyone from toddlers to their friends yelling their name ordering them to do stupid tasks and “Alex stop” repeatedly.
The name cratered in popularity for good reason.
Yet Amazon still has not renamed their dumb speaker
The "Alexa stop" thing, is it a real or invented harm?
My name happens to match the lead character of Karate Kid and I constantly asked to do the crane pose when I was 7. Doesn't seem to have traumatized me.
32nd most popular is not exactly obscure. Why did they have to give the computer a human name in the first place? Probably because it helps people form some sort of parasocial relationship to the product, which is gross, but probably good for business.
Also probably because it was good for business.
That anecdote is nice but honestly it sounds like you survived a less frequent and more temporary somewhat similar but much milder version so now you’re stating everyone else needs to get over themselves?
Your name is now Kleenexified to mean robotic female servant, no harm!
It doesn’t seem like you googled or looked into how people named Alexa actually feel before pronouncing how they should feel.
This comment chain really shows why these responsibility vetting teams are needed, a lot of corporate workers are not empathetic or considerate beyond their immediate siloed task and assume everyone should react exactly the same as they did to only very tangentially similar experiences.
Nonetheless, defaults are incredibly powerful. [1]
[0] https://www.rd.com/list/how-to-change-alexas-name/ [1] https://www.nngroup.com/articles/the-power-of-defaults/
EDIT: I don't know about these specific people or whether the blockers they put in place are justified. However, I've definitely worked with developers who obviously prefer to just write code until something works with little regard to the reliability, efficiency, security, or maintainability of their output. I spent almost all of my time cleaning up messes rather than getting to build anything new myself. It's a terrible experience.
Yeah, that's not what this team was responsible for, though. That's what an enterprise architecture team ought to be responsible for, but rarely are.
The number we have today minus those unemployed minus those on responsible innovation teams. (Using the broad definition of elites, which captures pretty much everyone who went to college.)
That said, it does sound like a strange function to allocate to a specific team.
Most "builders" are, if not constrained, like cancer cells. Unlimited consumption & growth without a counterbalance. In order to justify their own existence, they need to continue to churn out things without concern of what they consume, what use their product has.
Maybe, just maybe, there's value in having different kinds of personalities - unchecked by itself, pretty much every tendency is ruinous.
Also, false dichotomy there saying a "responsible innovation" team is needed to limit the building of products with no use; that's a solved problem. We have markets for that.
It is hurting society. What is to be done? That is the issue at the heart of this headline.
In theory these teams could do some good things, in reality it attracts or creates horrible people with INCREDIBLE efficiency / creates a cycle of endless meetings / recommendations... and it is endless because it is in their best interest to have an endless amount of "work" and inject themselves in a way that costs them nothing, and everyone else a great deal.
I figured these teams were the easiest place to find people who provide nothing at all / get in the way of folks doing things and almost always they don't accomplish their goals anyhow. They wouldn't even know if they did accomplish their goals anyway as these groups tend to center everything on their actions / the goal is them doing things endlessly.
Somehow word got back to them about the joke, they blamed the wrong person for the joke, tried to raise a hubbub with HR (to their credit HR told them to pound sand). And then they got all laid off ...
I'm a believer in some sort of cross-validation and quantification. The ethical impact of a technology should be quantified, and addressed if significantly negative (or promoted/incentivized if positive!) -- you can quantify number of users impacted, give various arguments, soft measures and estimates. Then, you can have other teams validate those estimates. After all said and done, you can again evaluate an intervention (on both ethical terms, and on the productivity and profitability of your company), and see if it was good or not. If a team is repeatedly giving bad advice, I think you can then address that (retraining, lay off, etc.?). Ethics is not impossible to do :)
I believe a certain generalization of this is needed for the entire society[1], to externally address good/bad technologies. A good example I cite all the time is Open source contributions. We still haven't found a good mechanism to pay OSS, despite the immense value it brings to society (openness itself has a value that direct sale couldn't capture). I'm a big believer in distributed evaluation and cross-evaluation: if we had distributed entities to evaluate impact of various ventures (for efficiency, properly categorized and subdivided into science, technology, social costs/benefits, environmental costs/benefits, etc.) we could apply the same logic to make society more adaptive, distributed, and less focused only on the single goal of profit. (I plan to elaborate this further, I think we are going to need to "patch" our current system in some sensible and careful ways to get a really good 3rd millennium!)
[1] Previously sketched this here: https://news.ycombinator.com/item?id=28833230
They attract or breed people who see it as a great / easy job simply to provide oversight but have no investment / zero consequences for what happens. They can give tasks, eat up time, it costs them nothing, but costs everyone else tons of time.
They are also free of any consequences ... how do you know such a group did any good? It's entirely for them to define. "These products were ethical, and we made them that way." Easy to say.
IMO these kinds of questions are up to the folks in charge of the products, beyond just a random group deciding "is this ethical" as they actually also have to understand and know them. If the folks making the product can't handle it, that's the problem.
Or worse, you're cutting corners that should not be have been cut.
Now in terms of this particular abuse prevention case, the problem requires a serious social and technical solution that would be expensive for Twitter to implement, and would harm their revenue to boot...
It's very much in the spirit of "the bureaucracy is expanding to meet the needs of the expanding bureaucracy". There's no better way for someone to justify their existence than creating problems but appearing to solve problems for other people. Compliance, security, etc. These things are usually necessary but it does attract a certain kind of person who seems predisposed to empire building through obstacle creation.
You see the same thing with people who become moderators. I saw this years ago on Stack Overflow. You see it on Wikipedia. You see it on reddit. You have to be constantly vigilant that these people don't get out of hand. These people end up treating the process as the goal rather than the means to an end.
I remember when the moderators starting closing SO topics as "not constructive". There were a ton of questions like "should I do X or Y?" and the mods decided one day to start closing these became there was no definitive answer. You can list the advantages and disadvantages of each option and list the factors to consider. That can be incredibly value. Can this descend into a flamewar? Absolutely. But just kill the flamewars and the people who start them. No point throwing out the baby with the bath water.
For another, the ever expanding administrative overhead of colleges is a large contributor to driving tuition increases. See https://stanfordreview.org/read-my-lips-no-new-administrator... for an idea of how bad the problem is getting.
I don't think that was a decision made by the mods, I think that's policy created by SO. I really like that it's so focused, clearly defines what is on and off topic, and strictly enforces that policy. You're right, such discussion can be very valuable, but if these policies didn't exist or weren't enforced, I don't think the site would be nearly as useful. Doesn't mean that the people with closed questions are bad, or the conversation can't be had in chat or a different site.
> Can this descend into a flamewar? Absolutely. But just kill the flamewars and the people who start them.
Meanwhile the strong contributors get tired of dealing with (even more) toxicity and move on, the signal:noise ratio drops, and it turns into just another (ostensibly) programming-focused forum. Not to mention that the more time mods spend dealing with toxic behavior, the less time they have for work that improves the content of the site.
There was little to no direction from the top, at least at that time. Mods were just self-appointed community members who organized in such a way to impose their will on the community. It was pretty classic tyranny of the minority. Many of the more prolific contributors (of which I was one at the time) were deeply frustrated by this. It was a frequent topic on Meta SO.
You saw these waves of subtle policy changes if you tracked edits to your contributions. Suddenly there'd be a bunch of edits all based on some new formatting policy and a lot of it was just pointless busywork.
Some people just fall into this trap of elevating the process to where the process becomes a goal and is treated of equal (or even higher) value to the content it's applied to. Moderation is important and has a place but, left to their own devices, moderators will create work for themselves just based on their idle capacity. You need to avoid this.
And then "toxicity" just gets redefined to an always leftward-moving definition of anything "right-wing". Every time.
Steve Jobs: "focus is about saying no"
Mark Zuckerberg: "move fast and breaks things"
Facebook is the world's least-trusted, most-reviled brand. They earned it by building garbage.
No one (aside from engineers) cares about what facebook built. Facebook had scandal after scandal and on top of it, everyone's grandparents signed up so teenagers couldn't post all of the screwed up stuff they were doing anymore. Posting there turned into a mix of corporate scrutiny (especially prospective employers) mixed with the old forwards from grandma emails you used to get in the late 90s/early 2000s.
That's why facebook is dying.
At a glance, our comments appear to differ substantively. At closer inspection, the only disagreement we have is what to include in the 'building garbage' bucket.
In case I misused language, I can rephrase my original point: FB is in a bad place today not because FB was ever slow to build, but because what FB did build was too often bad for users (for that matter: bad for humanity).
They built an amazing product... for a world that had only teenagers on social media. This was the truth for quite a while, and was true of the world they created their product in. They just never really updated their product to account for the new reality. Sure, they changed the algorithm a ton and re-tweaked the UI, but the algorithm and the UI weren't the product. The experience people had on the site was the product.
They're sort of like IBM's mainframe division. Mainframes are kind of cool if you ever get to tinker around with their hardware, and they're impressive engineering marvels (so are facebooks systems). But the world has changed since IBM was on top, and they don't fit what most people need anymore.
If I make a pizza with tasty, fresh ingredients - but then top it off with rotten fish guts and mouse turds – it's a garbage pizza.
And those "features" are all fine in a world where the internet is mostly young twenty-somethings with no power, as the internet was in the early-mid 2000s. Also for a product where you can just put in a fake name, as we could back in the day.
those "features" are all fine in a world where the
internet is mostly young twenty-somethings with no power
No matter a FB user's age, it is a problem to implement a dark pattern that leaks private information. There are countless illustrations of that, but one obvious one is how it resulted in many early FB users falling victim to financial fraud (eg: http://givemebackmycredit.com/blog/2011/04/facebook-and-iden...). As for Beacon, it was clearly poisonous from the start (https://en.wikipedia.org/wiki/Facebook_Beacon).I closed my FB account in 2011 specifically because the design of the site abused its users in countless outrageous ways (come to think of it: "Are you sure you want to close your account? [These friends] will miss you").
I really don't see us coming to any agreement. It's been fifteen years and, while FB has pumped out plenty of LoC, FB has never shown an iota of respect for its users. No surprise then that the brand is dirt, and Zuckerberg has to spin fairytales about how its 'metaverse' will stem the decline. Their ability to execute is not the problem; the demographics of their user base is not the problem; the product itself is the problem.
Ditto for financial audit teams and so-called "IT security": all they do is block, I've never had anyone in either function build something or help me work faster, just additional processes and bureaucracy that slows down real work.
edit: I thought my sarcasm would be apparent, but Poe's law strikes again.
They do fill a role that actually needs to be filled, though.
As we grew into a large company and our security team became an entire organization at the company, the org lost all connection with the product and became a more classic blocker-based team. The org lost empathy with the product and was judged on no product metrics, so naturally the culture in the org began to just be saying "no" to engineers all the time. A few of the earlier hires still try to help, but for the most part they just block.
"But, but, but aren't we all on same side?!"
"Oh you sweet innocent child..."
Once this manager understood the rules, they did quite well playing the game.
"Responsible innovation" is not discrete.
In simplest terms, one can judge if security is succeeding with a security audit. Either access is avaiable to the right parties, or not.
One cannot say with certainty if one is being a responsible innovator.
If your products are great bc they are are built quickly on top of a swiss cheese security policy, the security team is à blocker (or at worst, a delayer) of the company bankruptcy from fraud/fines/asset loss.
If responsible innovation is blocking product, its not certain what (if any consequences) there will be if the product is unblocked. Therein lies the problem
This checks all the boxes on Poe's law:
[x] Parody
[x] Reductio ad absurdum intent
[x] Extreme view
[x] Mistaken as sincereThey consistently thought about the nuances of baking privacy into a product in a way that I didn't have the background or time for. Every time I worked with them, they helped me build a better product by helping me tweak the specs in a way that had minimal impact on our users (unless they were a bad actor) and strongly increased privacy protections. It was like having a specialized PM in the room
My boss once did a similar thing with the quality department. Suddenly we sailed through our DFMEAs. Some people do live to block others, but some are trying to do an important job. Engagement usually pays more than just whinging.
It sounds like they were focused on building product too, then, which is not at all what this is about.
The day to day was reading the comms for a bunch of projects, finding places where you could be valuable, then reaching out to a bunch of project owners and convincing them to talk to you about the project.
I had them reach out once because I was working on a project that dealt with data for school children. We were exploring to see if we could use data help teachers intervene early and prevent bullying. They reached out to make sure we understood the legal implications of dealing with data for minors, and that we weren't just building a product that would encourage the administration to pigeonhole students.
After a brief conversation we got signoff and some great feedback on how to support positive outcomes while avoiding the risk of creating something that felt Orwellian
Sounds like something from Silicon Valley, the TV show.
1) It's starts after the product launch post-mortem 2) Team creates a process to improve avoiding future mistakes 3) Process innocently includes ability to hard block any product changes without someone or some group's approval 4) Politics emerges behind the scenes from those with social capital to get around the hard blocks 5) New process to make things "more fair" by adding more hard blocking rules, usually resulting in lots of pointless meetings and paperwork to justify new process and show upper management that things are working as intended 6) More politics as teams start hiring for people who are able to get around the heavy process by being "good at the game" 7) New team is formed around the process because it's now a full time job 8) People good at politics join this new team and everyone else is pulled into pointless meetings and handed paperwork 9) Rinse and repeat
The problem I've always observed is that these systems are put in place with the best intent to offer guidance so that company, employees and consumers can all benefit by building the right best thing. However, the systems are given blocking abilities that after time do more damage than good.
You'd think, if something were not blocking no one would listen, and maybe you're right. I definitely have no idea how teams can avoid this spiral trap, however, I don't think it's a bad thing to sunset process like this after a while. Just like Google is willing to throw away products on a whim, we should be willing to throw away process teams on a whim.
The point of such teams is not to improve ethics. The point is to have enough credibility to affect the discussion. (E.g. observe how much "research" in AI ethics has financial ties to large companies that are heavily invested in AI-based products at the time.)
What a properly ethical corporation would do is openly admit conflicts of interests and listen to external feedback.
This team at Facebook had a very low chance of doing anything good for the company.
They will survive, but they will bleed and shrink a lot, and their relevance will likely be insignificant ten years from now.
The Metaverse bet is dumb, they simply can't execute and even if they could this whole Metaverse thing is likely to stay in the videogame's realm for a very long time.
I see it as an attempt to keep propping up the stock value, I don't even think they believe it themselves
10 Billions a year.
edit: it coincided with fb reporting saturated user numbers
Talk to anyone you know who works at Meta - it's obviously the top thing on Zuck's mind (and that's been clear every Thursday for years now). FRL is getting huge funding in a way it wouldn't if this were just to prop value.
(personally, I admire that - FB has pushed VR technology forward a couple of generations, singlehandedly)
Thats like trying to tag your kid as a Heisman trophy winner as the kid is being birthed. Sure be a proud parent but understand you are delusional.
Facebook is a company with nearly two decades of big tech experience, 40,000+ employees, and unfathomable amounts of capitol/IP/assets. To see them make the same logical leap as a two person startup of fresh-out-of-college optimists.
That'd amount to converting 30% of all Facebook users to VR users, worldwide, in four months. Including a bunch of users internationally who don't even own computers, and certainly can't afford VR hardware. "Delusional" is absolutely the word for it.
I am curious, but I have low expectations.
Who says they’re replacing ads with VR?
There are already concerts with paid tickets going on in platforms like Fortnite, that just happen to be able to act as multi-user VR environments, even though that wasn't their designed purpose. The demand is real.
I don't see it as much of a bet that "people are already creating these events, and want to build professional services around doing so; these people would appreciate a platform to run such events on that won't be shut down/go unmaintained in two years just because the game that the platform was built for ceases to be relevant; and people who pay to attend these events are willing to download a client to consume the content they paid for." That just seems to be a series of common-sense facts to me.
Whether Facebook can actually end up as the platform of choice for hosting said events is entirely non-obvious. But, if nothing else, they do have connections, channel partners, global scale to deploy reliable infrastructure that can be trusted to not buckle under event load, etc. It's up in the air how much things like "the aesthetics of the experience" really matter, compared to those. How much does a band care about the aesthetics of the venue?
If they can execute (I believe they can't) and if the Metaverse is the next huge thing that some are predicting (I think their vision is too dependent on VR/AR magically becoming practical)
They still have a huge reputation issue; they are already bleeding users on FB and Insta.
They need a miracle.
https://www.statista.com/statistics/1222146/xr-headset-shipm...
I mean, engagement, not market share, total time spent by users with the headset on.
My intuition is that 90% of that "market share" is collecting dust.
As for that new intuition, what good reason is there to believe Oculus headsets are so vastly underused after-purchase compared to competitors? And what has that to do with Meta's reputational issues?
Because everybody I know who's bought a VR headset (any brand) lets it collect dust after a month, and I don't think that's a fluke. Buying a VR headset is not using a VR headset.
The company sure has reputational issues, but as much as people hate it (I have my own deep issues with it), it's not stopping the larger masses of people from using their products. In fact, >85% of humans (ex-China) with an Internet connection to their apps and >70% of VR headset purchasers.
Whether VR is a fad, people who buy headset find long-lived utility from them or the push is a good/bad bet for $META is unrelated to what I meant to say, which is their reputation is not stopping them from currently dominating the VR space (non-premium only so far, but maybe with Cambria). Doesn't seem reasonable to think the 7-8 digits of current VR enthusiasts are less morally principled then the 9-10 figure masses would be.
You have that the other way around. Fortnite was able to host a concert because people like to play Fortnite. There is no demand for VR concerts, there is perhaps some demand for concerts in already-populated online spaces.
People aren't flocking to Fortnite because of the concerts. People who play Fortnite are flocking to these concerts when they happen in their game.
Megan Thee Stallion, Billie Eilish, and the Foo Fighters are all releasing VR concerts this year.
My wife, who has never played Fortnite, attended several VR concerts over the past few years.
Given how popular listening to music is on services like Youtube, I believe it is short-sighted to fail to see the appeal of an immersive 3D-audio VR experience for music fans.
New toys are fun to play with, for a bit. That doesn't necessarily mean they're going to stick around or have much long term relevance.
There's no demand to watch computer animated concerts through heavy glasses in Fortnite coming from people who don't already spend a bunch of time playing Fortnite. This is an add-on to Fortnite, not anything that anybody really wants to do for its own sake.
What's the point of watching a computer animated "concert" in VR anyway? Who would get any joy out of that?
There is no way to convey this without being a little bit of a jerk, but I think your take demonstrates being out of touch, in the "no wireless, less space than a nomad, lame, also Dropbox is just some tooling around rsync" sense that HN tends to get sometimes. This is enough of a phenomenon that other mainstream artists are starting to get into it, which means there are enough people getting joy out of it for it to have a market of its own.
I think you ignore the metaverse (the concept, not Facebook's janky implementation) at your own peril. The next generation is growing up with virtual concerts, and in many cases virtual artists.
[1] https://variety.com/2020/digital/news/travis-scott-fortnite-...
And that's not counting the upcoming stuff. Trying to write off something this successful as a pandemic driven fad kinda speaks to that whole being out of touch thing I was talking about.
https://www.theverge.com/2021/9/28/22699014/fortnite-soundwa...
Second, Meta is a huge corporation, the money makers don't let the kids play for too long, and they won't let Zuck burn all the cash, no matter how much theoretical power he has in his hands, they won't let him bleed the cash cow to death.
Third, we have enough History to see a pattern, Nokia and Kodak saw the iceberg, it didn't matter.
And small things like Carmack leaving and Zuck being delusional are clear hints of what is going on internally.
https://www.youtube.com/watch?v=SAL2JZxpoGY
Just a ton of little things. Woman floating horizontally in space. Possible to render. Not possible to convey to the player. Cards, basically impossible to actually have cards that have good physics in a networked game like that. The smooth floaty motion and spinning is particularly dumb.
You could just have head and hand tracking with the rest of the body rigged and animated separate from the tracking. Player doesn't control the legs, they just dangle and animate.
The cards are technically possible. The trick is you just fake the physics. It doesn't need to be networked in a low latency way at all.
I would say the least realistic is the fine grained tracking and handling of things as thin as cards. Hand tracking isn't tight enough to manipulate a hand of cards naturally yet. That said, if you give some leeway to what the first person UX is vs how other avatars are displayed, its not so far off from whats possible especially if you would allow "reveal your hand and have it float away in zero G" to be pre-canned animations that the user triggers.
But you cannot feel that way. Yes, you can render it. You cannot make a player actually feel like they're there. You can't have fun doing loops like that. Even if we could somehow suppress the immense nausea of doing it, you would not be having fund doing a loop because you are not doing a loop. This is the big lie of VR. It's just the eyes, not the body, and there's a huge difference. You arguably get more bodily immersion with a 3rd person view watching your avatar's body do things.
"I am the person I'm watching doing the thing" > "I'm literally me, and I'm going to try to believe that the weird body ik is what I'm doing".
Ready Player One (which I don't like but is the poster child for fake VR UX) does this a lot with subtle things, like the characters jump from a precarious ledge and then struggle for balance on the precipice. That's impossible to achieve! You may struggle for balance irl, you may put balance mechanics into your game, but you cannot force a player to FEEL off balance because their VR foot is now on a ledge.
> I would say the least realistic is the fine grained tracking and handling of things as thin as cards. Hand tracking isn't tight enough to manipulate a hand of cards naturally yet. That said, if you give some leeway to what the first person UX is vs how other avatars are displayed, its not so far off from whats possible especially if you would allow "reveal your hand and have it float away in zero G" to be pre-canned animations that the user triggers.
There's a really big gap between what they're implying and what we can actually do though. Cards are super thin, and bendy. You can stack them together. You can manipulate them with your fingers. You can fan them out and shuffle them. Paper thin collisions are not something that any game engine really tries to support. You get fake deformation (bending) of meshes, but it's always kind of shit. The physics of it is extremely difficult to do, and trying to replicate that level of precision is probably impossible in the foreseeable future for a number of reasons including the ones you mention.
Can you make a great player UX with cards? Absolutely. You can do all sorts of stuff to give the visual implication of bendy cards and shuffling and fancy finger work. But you cannot actually let the players do it with their hands. You're not there. You're interacting with a very, very high level interface to the game world. We won't ever get the user experience meta is implying. It's pretty much impossible without a fundamental shift in how game engines work.
It's a moon shot, but I wouldn't call it dumb, it's actually a pretty obvious business decision. Keep in mind, Oculus (now being rebranded as Meta) is currently the preeminent VR platform and has sold more devices than every other competitor combined. This is a potentially huge opportunity for them to expand their social media reach into a completely pristine market that they already dominate. Meta is in a unique opportunity to define the future of VR, it'd be dumb not to try something like this.
Of course, none of this addresses the abysmal branding or Meta's horrible reputation or the public's perception of Zuck as the herald of a technocratic dystopia. I also agree that VR will indefinitely remain within the realm of videogames, and gaming is not in Meta's DNA which I think will probably be their biggest barrier to success. Still... they own the VR market, they also have plenty of cash on hand, and that goes a very long way when trying to make the impossible possible, e.g. the xbox...
Also, MS had quite a bit of experience in building/maintaining a platform for developers.
Frankly, we're not talking about the same kind of leap.
There's a lot of IP and patent rights to be gained. Even if Metabook shrinks back, they will always have a possible revenue stream in enforcing those rights and collecting royalties on newcomers to the VR market.
Whether Meta can execute on the metaverse bet is fair question, but I expect most of the changes they are envisioning will come one way or another.
I don't want to strap a thing to my face and "be in VR" for a long period of time, navigating menus by pressing giant virtual buttons or pointing lasers at them. I want to, while using google maps on a phone or computer, be able to hold the headset up to my face and look around briefly and then take it back off. Same with data visualizations, 3D models, short-form entertainment, etc.
Standing in VR looking at loading screens is an awful experience. It should already be loaded to what I want to do.
It's hard to imagine Meta making that pivot since they seem to want to have a walled garden like Apple's. But they could at the very least make navigating/loading by a phone app an option. Even track the phone in VR, have a mirrored twin of it (with a kind of blown-up holographic version of it you can more easily read), that you can use in and outside of VR, and instead of their controllers.
I think something that can improve the remote work experience could be worth a lot. It’s still to early to judge.
Meta's headcount grew 32% in one year, and revenues went down 1% YoY in Q2. Wall Street expects it to go down even more YoY in Q3. Layoffs usually happen in September since that's when budgets are set. So they objectively overhired, expect to shrink, are now just laying off non-revenue generating divisions.
Some can argue there's no such thing as non-revenue generating divisions. Every division contributes, and this one could have helped with the Meta brand, public perception, user retention, etc. But the real way you solve that (as AI researchers have solved) is not having a firefighting team that's expected to fix everything; it's instilling the proper behaviors, processes and culture within each and every team in the company. Having these discrete "divisions" serves PR goals more than anything, and that's expensive PR.
This is exactly like Steve Jobs laying off the Advanced Technology Group. Did that signal a "neglect" of R&D? No.
I personally believe that even Meta management is far more pessimistic about its stock than Wall Street is, and that's why they're playing it careful. Wall Street expects a 10% growth in revenue in 2023. Usercount isn't growing. So FB needs to cut spending and focus on core product and increasing revenue per user. Straightforward.
Option A
1) ethicist objects to something
2) management declines the objection
3) whistle blower reveals the declined objection
4) public outcry ensues, stock price falls
5) board members become agitated
6) c-suite wakes up to another gut punch
Option B 1) ethicist raises an objection
2) management acts on the suggestion
3) revenue misses target
4) stock price falls
5) board members become agitated
6) C-Suite wakes up to another gut-punch
Choose.Then we can just skip steps 1-5.
[1] https://www.barrons.com/articles/facebook-stock-tech-apple-5....
Lots of minorities actually love this feature because they can find people from their own community. If it were up to teams like this, they would remove the gender filter as well. I’m glad these crazy Twitter people were fired.
You get decisions like this after profiling use cases - targeting by race might be vector for targeting minorities for hate crimes.
Community/social sites (in my opinion) should not double as dating sites - for safety reasons.
The reason we can't have nice things is because of bad actors: all design needs to account for bad actors.
Assholes ruin design: Don't shoot the messenger - or stop taking their calls when your own team tell you they exist.
> The team was made up of engineers as well as people with backgrounds in civil rights and ethics, and advised the company’s product teams on “potential harms across a broad spectrum of societal issues and dilemmas
I suppose the question is whether people are surprised that this team existed in the first place. It sounds like it adds lots of legal liability of knowing about certain problems and not doing anything about them in due time. I wonder what they ended up finding if they found anything at all not already known to the public.
On the other hand, security teams are highly regarded in a company, even though they are supposed to identify security/privacy problems in the org as well. What made security different from those ethics teams?
i doubt it. High regard for a security team is only projected, especially outside, because it is perceived as a virtue. "Security" these days in many respects is like communism ideology back then in USSR - there is just no option of not claiming allegiance to it. Where is internally it is usually just a theater. Just look at all those large publicly known breaches.
>What made security different from those ethics teams?
You can claim allegiance to ethics without having an ethics team, fortunately.
should really say
"Group was put in place to make people think the company cares about the downsides of the company's products; Meta says something meaningless about continuing efforts"
From law enforcement to newspapers to government to technology — unless there’s demand from the public and oversight is independently funded and managed, without fail, function of team will end up either functionally meaningless or aligned to the parent organization’s core objectives.
Beyond that, no venture is without flaws, and until people are able to acknowledge that optimal solution do not mean zero negative impact, it will be a race to the bottom for which another culture that’s able to manage the complexity either by luck or skill will eventually replace those who are unable to do so.
In an ideal world the "responsible innovation" team would represent one side of a "speed and scope" vs "PR, compliance and political considerations". So even though it goes against some of Meta's goals, it would be valued for achieving others.
However sadly in practice any time a set-up like this has "money" on one side of the balance, it's always going to win. So the team was set up with an impossible task.
Whenever I come across a dystopian sounding name like that, I immediately distrust them.
Which usually happens due to lobbying by said private firms
If profit is winning, then any large enough business will do anything within the bounds of those rules in order to increase profit. You wouldn't ask basketball team to stop taking advantage of whatever edge they can to win would you?
Private firms have been evaluating the harm they cause since tobacco. They need to know precisely what they need to cover up under the guise of discovering societal dangers for social good.
"If society didn't want me to kill all of those people why didn't they stop me?" is not really a good look. Abdicating all of your personal responsibility to "society" is just an excuse to be a sociopath.
Whenever there's a lawsuit against Meta, the plaintiff can do discovery and demand all this stuff. So the only defense is not to have it.
"Meta top management was made aware of all these harms, but did nothing about them." -- that's not what their lawyers want to hear.
Bonus benefit from disbanding the team now: if more shit happens, can re-create the team as a show of action without actually changing anything.
Meta dissolving that team can mean two things, either that they lost hope to get away with it, or that they are confident that they will get away with anything, without even pretending.
Though we definitely still have miles to go to limit the influence of corporations on gov't (and even public opinion by limiting media centralization and funding independent media), I doubt we'll ever be able to fully limit their influence.
Well that's one issue. The government only weakly equals the people, because of the electoral college disenfranchising voters in NY and CA, lack of ranked choice voting, Black voter disenfranchisement, lack of statehood for DC and Puerto Rico, and the corporatocracy system of influence.
> If the people are unwilling to perform this basic function, private firms shouldn't feel obligated to take the mantle of responsibility.
Sounds made up.
What sounds made up?
Also, related to nothing, why have a bunch of people on the internet started replying to everything over the past few weeks with "sounds made up"?
Under your proposal, we the people and the laws would need to anticipate any harm a company might do, otherwise they are off the hook. Sure, there are laws now against semiconductor companies pushing their chemicals into the ground water, but what future chemical might be in use that isn't named in some law currently?
A second point is that of regulatory capture. If a company can spend $100M lobbying politicians, courting regulators, spending on PR to sway public opinion to believe false things, and as a result earn $1B in extra profits, that would be AOK under your plan.
Every time someone trots out the false claim that it is a CEOs legal responsibility to maximize profits, I have to wonder about their ethical framework, as if maximizing profits is an inherent good.
The problem is that you're talking about how good people are, when other people are talking about how well things work, and about figuring out how to make them work better. Your ethical framework seems to be that people should be good and do good things, but with no reference to what things are good and what things aren't other than the intuition and improvisation of good people, and no reference to what we do if they don't do what we think are good things.
If you're relying on the CEO to be a good person, you've dismissed governance as a possibility and anointed kings. In general, I don't think that kings work in my best interest, so I prefer regulations.
Oh, you mean like how Meta has access to your data, sells it, and also sends some/all of it to government intelligence agencies?
Or how they manipulate, censor and promote content, shaping public opinion (of Facebook users anyway)?
Or how Facebook is addictive and exacerbates anxiety in many people?
Those kinds of downsides? Gee, I wonder could possibly happen to such a group.
Most engineers I know are responsible and ethical, and have strong moral compasses.
Something similar happened in Australia when an old climate change denying government dispanded the "Climate Commission" (a government department tasked with investigating climate change) to save face. The employees of that particular department packed up and left their office, got funding and now they're known as the non profit Climate Council. They have remained a thorn in the government's side ever since and are still going almost a decade later https://en.m.wikipedia.org/wiki/Climate_Commission
Good to see they get let go.
From a Silicon Valley veteran: if you work there and read this, and you don't already have your resume circulating, it's too late. You want to be out there before all the other Meta employees.
This may not have been a problem in 2018, but it's definitely a problem in today's current environment with large amounts of bay area companies slowing their hiring.
If you look for a job before all this, you're in a much better position at least.
I wasn't around during the dot com era, but there were stories of devs ending up taking any job (programming or not) to make ends meet.
The word "facing" is present tense, which is not the appropriate context for this scenario. Everyone will have trouble if Meta fires a bunch of engineers. People from Meta may have a little less trouble, and some companies will even open up new reqs to absorb some for cheaper. But there are a limited number of open positions out there. No real imagination or speculation is required here, since this has all happened many times before.
Unfortunately these times can be a bit rough to navigate. It can be tempting to cling to one's current position rather than move to a new company & be first on the chopping block
By the time layoffs or a mass exodus actually happen, you're competing with 100s of other good devs for the best jobs (not that you won't find some job).
Cracks me up, just how close SV (series) is to out there..
the fact that journalist himself is in 20% is irrelevant as its his bosses who finally decide what gets to your/mine eyeballs.
Edit: If I’m honest: S3.
1) They are literally created by these companies as a means for deflecting attention from the real problems that are occurring at a higher / hidden level. For example, these people have no idea that Facebook has actively lobbied to prevent countries from enacting a digital tax that would more fairly spread the tax revenue associated with profits generated in countries around the world. There's nothing these people would ever do about that in their "work."
2) The people who take these jobs are generally quite terrible. They are willing to accept a paycheck from a company whose ethics and tactics they supposedly find reprehensible. If we take their jobs at face value, they are paid to show up every day and hate what they see and criticize it. It takes a certain type of toxic mental state to find that appealing, regardless of how much money you're making for doing it. And, if you're motivated by money to take such a job, well... What does that say about you?
3) These teams spread the false belief that these companies are so big and powerful that you have to try to "fix it from within," rather than doing what we have done so well for so long in the tech industry: we've burned these empires to the ground and started all over, with something better/faster/[eventually] bigger.
4) People within the organization who know that these teams exist for regulatory / PR purposes think that they've been given cover to continue to act in shady and unethical ways. These sorts of groups perversely make it easier for the bad actors within these organizations to continue acting bad, and sometimes even act worse. Facebook and its current/former executives are the gold standard for this: the more you see "regrets," "internal dissent," etc, the more utterly depraved and shameless the behavior behind the scenes is.
In summary: Bad people working for bad companies that do bad things. Pointless jobs at best, a net negative at worst. These are toxic jobs that attract toxic people.
Thankfully, none of this really matters, because Meta/Facebook is slowly disintegrating and there's nothing Zuckerberg or anyone else can do about it.
(And before someone posts the inevitable "2 billion active users" response, do remember that these are network effect businesses in which the network effects need to be constantly replenished with new and exciting reasons to stay connected. If people are more excited to be connected somewhere else, you're dying. And, the sort of people who invent exciting new reasons to be connected don't work at evil corporations that silo "responsible innovation" off from the "real work.")
0 - https://www.forbes.com/sites/kashmirhill/2014/06/28/facebook...
A company with this level of influence over the world should work to be self-calibrating: don't significantly manipulate people, block the spread of hatred, don't let unknown actors influence global politics, don't design your products in a manner that others can use them in ways you don't expect that cause people harm, etc. Does that still happen at Meta after this? I doubt it.
Seems like that's an important piece of information to have before passing judgement on the decision, I think.
I agree, but given the company, context, and reporting, the only people that would categorically know are Meta insiders, and journalists poking at them...not most casual HN commenters. :)
The problem isn't misguided or unregulated corporations the problem is capitalism.