“People.”
(From the second book in the altered carbon series)
If you trained against a dataset of all police stops in my state (CT) to predict which vehicles should be stopped to maximize drug finds you'd include multiple large departments that have been under federal investigation for racial discrimination (and were found guilty).
I don't think the hidden agenda would be intentional, but there would be a hidden agenda.
Secondly, optimization algorithms "have no hidden agenta and are predictable" only insofar as you're able to comprehend their implementation. Which, for anything more trivial than blinking an LED, you're most likely not. This is the core of what's known as "programs have bugs" problem in software engineering, and also of the "bugs are exploitable" and "programs can have hidden backdoors" problems in software security engineering.
That's not a given.
Here are just some of the assumptions it is making that are flawed beyond repair:
- Algorithms don't have unexpected behaviour.
- Computer programs operating in real time are predictable
- We can agree on what to optimise for
- Checking the source code is always possible
- Checking the source code allows you to understand a program
There is definitely a market failure here, but it's not clear why.
This is why some countries have enacted laws to help with that.
https://www.statnews.com/2016/08/25/mylan-antitrust-epipen-s...
"They keep trying, and the FDA keeps refusing to approve them for human use."
Of course that patent doesn't prevent other epinephrine autoinjectors from coming to market (and Adrenaclick is available in the US, including a couple generics).
My take is that the FDA should have some authority to deny market approval for such small improvements if the company refuses to license them to generic manufacturers. The hard part is deciding what constitutes a small improvement.
If people start to pay attention to the process and the corruption surrounding EpiPen, will it blow the lid off the entire FDA system?
But corporations don't make decisions, those are made by the actual human beings that work for those corporations. Those human beings belong in prison.