Roblox Open Sources Real-Time Voice Safety Model
research.roblox.com
research.roblox.com
The level of safety varies from instance to instance. If the AI detects someone being disruptive, it asks if you want to mute them, even if they're far away from you. You're notified when your voice radius is extended when AI deems you to not be a threat. You can garble people's voices like in that episode of Black Mirror.
Basically, you're constantly reminded that you're being recorded.
that's never a sentence you want to hear about your product
The only way I can think of this being justified is if it's run and controlled by the user themself so they can control what they hear. Not to control how others speak.
Moderation is trying to enforce some standards for the whole environment. Even if you got the tools to implement filtering for yourself, you're still sitting there with people who are happy with the abusive environment and will get through one way or another. And you get them everywhere around you. It's not something that each player can deal with separately unless they opt into private groups - but that's not the environment Roblox is encouraging.
E.g. while it's not perfect, Valorant's audio chats are a lot less toxic than many comparable FPS games via such a system. Of course that still won't protect you from one-off hearing slurs.
So that + elective client side filtering (if you really never want to experience profanity), seems like the best of both worlds.
manual reports + reviews requires recording the feed for later review; real-time filtering does not. A number of other commenters have mentioned that being recorded bothers them; those folk should be arguing for the real-time AI moderator.
This absolutely will be used for surveillance. It's literal express purpose is surveillance and automated behavior modification.
Basically, if anyone wanted to do surveillance like this, they were always doing it with public or secret implementations. This won't massively help anyone.
Imagine a place on the internet where your speech is moderated, like a place you’re not forced to use and has rules about what you can and can’t post. Speech that goes against the rules could be hidden or removed and the users of the service train themselves to speak in a certain way when they are using it.
Perish the thought, that sounds like a dang dystopian Netflix show
But yes, please keep defending the development of mass surveillance technology.
> In 1648, Tenshō Karuta were banned by the Tokugawa shogunate.[13] During prohibition, gambling with cards remained highly popular which led to disguised card designs. Each time gambling with a card deck of a particular design became too popular, the government banned it, which then prompted the creation of a new design. This cat-and-mouse game between the government and rebellious gamblers resulted in the creation of increasingly abstract and minimalist regional patterns (地方札). These designs were initially called Yomi Karuta after the popular Poch-like game of Yomi which was known by the 1680s.[14]
Is it good to automatically record, transcribe, analyze, and censor all private conversations? Is their goal even censorship, or is that a false 'child safety' justification for mass surveillance?
https://www.reddit.com/r/roblox/comments/16dlijo/roblox_aims...
If ROBLOX is not splitting up dating vs sexting, I see major problems with that. In an age-verified 17+ experience, I should be able to ask someone to go on a date with me. I showed my passport to ROBLOX to get in after all. Ditto for "Profanity". 17+ experiences can have strong language, unless it's directed at someone else.
https://devforum.roblox.com/t/17-experiences-can-add-support...
The guide says that I can say "fuck", but not tell someone to "fuck off". So, does "fuck off" fall under profanity or bullying?
Right now, I have a lifetime premium account for ROBLOX from 2008. The rumours I hear is that I'm on a hair trigger for bans because Roblox is trying to clear out lifetime premiums since they cost the company too much money.
It would make me feel more comfortable with using voice chat in 17+ experiences if I had more insight into the machine learning classifiers. What are the thresholds Roblox is using in production? Do they differ based on experience or the user? Can I easily run this model locally, talk some trash into the mic, and see what the boundaries are?
Right now, I avoid using voice chat despite having verified because I don't want to lose my valuable account. It would make me feel better if I had an idea of what the boundaries were, so I could avoid them.
...
paid for with revenue from years of predatory sales tactics, exploting defencies in Apple's parental controls by tricking children into buying things without their parents permission then refusing to refund them. Fuck these parasites.