That's very black mirror.
Also, didn't facebook get busted basically manipulating feeds to see how they affect people emotionally?
That's very black mirror.
Also, didn't facebook get busted basically manipulating feeds to see how they affect people emotionally?
Trust but verify
They were doing A/B tests and were tracking sentiment. So what? How is that different than running an A/B test and tracking any other dimension?
People were asking questions like "how many people died because facebook was manipulating their emotions?". What? Why can't we say that about any change ever? It seemed to only matter to people when they started looking at sentiment.
I still disagree, though. It seems like the only logical way to get out of your thought process would be to create software and then never update or change anything. Either that or have every user sign a waiver saying that the product could change in the future and that might impact them psychologically.
After all, why is it different when you're making a change without A/B testing it? Surely every change has some hypothesis attached to it. Does it only matter to you when developers observe the metrics changing?
This is a false choice. There are multiple ways you can ethically approach improving software, such as:
- user interviews
- A/B testing with informed consent
- user testing (directly observing the user while they use the software)
- focus groups
- feedback forms
- crash/error logging
There are probably more, but the theme among all of them is user consent. The ethical implications of using engagement metrics to drive software development is well-worn territory at this point, especially with respect to social media, and I don’t understand why the software industry seems to get a pass when others don’t.
Maybe we should do studies where subjects are consenting to it...
if the user can tell that something changes because of a new features/changelog that explains it (or lists it for more trivial changes), again, seems different.
I would be open to discussion on how it's the same, or how it's unethical, though