DeepMind readies first commercial product
ft.com
ft.com
No need to rely on third party service.
No need to rely on Chrome.
" Summary Data
Page length reduced by 38%
⏱️ 3 min read"
Maybe HN should ban paywalled sources.
It's the most disingenuous argument against free media (or piracy etc) that's being thrown around.
No, it's not. I actually used to write for a newspaper before. These days, they are shoestring operations locked in a constant battle for financial survival. The stories are written by real people who get paid (very little) real money. Take that out of the equation and the news goes away. I deeply value journalism and want it to survive. The level of entitlement evinced by you, gp, and many others on this site as regards the whole "information wants to be free" meme is simply stunning. Like, you really haven't given a moment's thought to what "free" implies here.
I know, that reality of dealing with non-scarce goods doesn't gel very well with free-market capitalism, but I think limiting access to journalism (and IP laws such as copyrights and patents) is a net negative for our society, so we shouldn't resort to bending our only post-scarcity type of good into a scarcity driven economic system.
Right, because every other developed countries gets similar outcomes at lower costs (poor capita, per GDP, or on any other reasonable basis for comparison) because they are far ahead of us on automated administration and billing.
There might be countries where that's what's needed, but in the US there's clearly a lot of lower hanging fruit that doesn't require any new technology.
Currently in the US the largest health insurance provider is actually medicare/medicaid. When a patient with medicare goes to the doctor, the government says "This is what we will pay for that procedure, no exceptions." The hospital has a choice to either accept that rate, or to lose out on the massive medicare market.
Private health insurances plans have vastly fewer subscribers, and don't have the power to negotiate prices like the government does.
But regardless, why is health care and insurance a for-profit industry? It creates incentives to put profits ahead of people's health.
Medicaid is more 50 different insurance providers (it's run by each state—with separate programs for, at least, D.C., Puerto Rico, and Guam, and it's not even a single insurer in every state, e.g., California uses a number of county-level managed care plans as well as a traditional fee-for-service plan.) And all of them are separate from Medicare. Which also is less of a single insurer with common coverage policies than it seems on the face (even excluding Medicare Advantage, which is just publicly subsidized private insurance), since whether any given procedure in reasonable and necessary and therefore covered in any given geogrpahical area in Medicare depends on local coverage determinations made by the private insurer that is the Medicare Administrative Contractor for that region and claim type (there are separate contractors, with different geogrpahical regions, for regular part A&B claims, home health and hospice claims, and durable medical equipment claims.)
If you have insurance, the price tag will be X, and they will pay for some part (most?) of it.
If you don't have insurance, the price tag can easily be 100X and it's your responsibility.
If you have insurance, but you happened to pick up that can of pepsi from the left aisle (out of network) instead of the right aisle (in network), they won't cover it, and you're stuck with the 100X price. You won't know that before you buy the can of pepsi, of course.
If you try to ask your insurance if they cover the specific can of pepsi from the left aisle, they may or may not tell you. They may or may not give you the right answer, and if they tell you it's covered but then refuse to cover it, it's your problem (and again, the price will be 100X).
The whole model of negotiated rates, rebates, etc. needs to go.
I also think the concept of networks is bizarre on the face of it. A certified medical provider should be covered to perform procedures in their area of expertise. Period.
Personally I like the idea of anyone who wants to be able to buy into Medicare A & B. And if you don’t have Medicare then you can always pay the Medicare rate of the procedure at 100% (versus having Medicare where your copay is 20%).
If insurance companies can’t compete with that then great.
I think part of the problem is absolutely opaque, discriminatory, and predatory pricing.
I went to get a basic blood count last month. I gave the lab my insurance card, but they must have copied a number wrong, because when I got the bill they had me down as self insured, and had a bill which said;
Lab Services : $1,541.00
Patient Adjust : -$ 385.25
Total Due : $1,155.75
I called back and gave them my insurance card and they said ignore the bill a new one will come in the mail.Last week I got the new bill:
Lab Services : $ 17.12
Insurance Pay : $ 12.12
Total Due : $ 5.00
Yes, I absolutely think it should be illegal to try to bilk a cash carrying customer over $1,000 for a $17 blood count test.Thanks but this sounds ridiculous to me. Doctors are people too who really do get paid and really do make mistakes.
Using AI to learn from the best of the best will improve results overall, and automating tasks that expensive doctors did will reduce cost.
Yes we need to handle the exploding and ridiculous administrative costs, but clearly there can be gains on both fronts of this battle.
This is an important factor in how we choose to build products out of AI advances. If your product replaces a part of a service chain that is not either right next to the transaction or in a competitive part of the supply chain, it might only help incumbents aggregate more power and charge more rent. If you can deploy in a way that improves the competitive landscape, you not only distribute gains more but probably keep more leverage as a solution.
This is harder for AI than many technology areas because incumbents tend to have more data and regulatory protection on that data. Health care might be the boss level for that problem.
In fact, it IS "a US thing": • Most major teaching hospitals mandate 24-hour weekend shifts for residents; • One "assistant" aka resident doctor for a psych ward overnight is standard
Retired neurosurgical anesthesiologist here who's been there and done that many, many times....
So many programs and devices are used where someone would be liable if they malfunctioned. In a production line for example, if something goes wrong and it has to be turned off, every hour costs $$$ to the production plant owner. Similarly for robots: there have been cases where industrial robots have killed people. Accidents with machines can happen in so many industries. If the machine is wrong in 0.2% of cases, that's a risk that can be calculated. If its rate of misdiagnoses is equal to the rate of a human expert, then replacing non-experts with it will improve patient experience. Of course, there might be super experts whose patients would be worse off if they were treated by an AI.
The Luddites are back! We'll see how this prediction holds up in 30 years.
However, a pragmatic approach would suggest that any form of AI and it's derivatives, would be assistive in the medical field and play a hybrid role, rather than being a panacea[2].
[1] https://news.ycombinator.com/item?id=17667375
[2] https://towardsdatascience.com/why-ai-will-not-replace-radio...
Every time I visit the doctors in the US there is a trail of paperwork produced. Outside of basic checkups (where you don't dare mention any niggling health issues because your instantly going to get billed consultation fees) there is always a back and forth between the patient, doctors office and insurance over what the doctors office is asking to be paid and what the insurance says it is prepared to pay. This is an enormous time wasting game - the doctors (or their medical group) ask for much more than the procedure cost to perform knowing full well that the insurance company will push back with a lower accepted payment and the patient will sat in the middle having to negotiate between the two.
Removing the pricing game would lower costs substantially (and vastly reduce the time wasted by regular Americans calling their insurance/doctors trying to sort out their individual billing messes).
Having lived in both the USA and the UK there is no question in my mind that the US health care system is a dysfunctional mess. In my experience the only place the US system has an advantage is that the healthcare providers are very (too) willing to send a patient for tests/scans to check for every eventuality and are happy to prescribe whatever medicine is 'best' for an ailment.
In the UK a fit person with a common cold would get sent home and told to not waste the doctors time, in the US you'll get a consultation and a dose of Z-Pack (and hey if I'm paying for my insurance I should use it when I get sick, shouldn't I).
https://www.forbes.com/sites/samshead/2018/08/20/facebook-ai...
If DeepMind is trained on millions of MRI’s, we might have better preventative medicine.
The FDA will probably set the low bar of validating that the reconstruction algorithm fares well in the face of a few abnormalities and call it a day, instead of the proper (admittedly infeasible) validation of testing against all abnormalities that the reconstruction algorithm will encounter. Facebook will probably happily jump over this low bar, and patients will get hurt.
I view the whole issue stochastically, with the immediate aim being to make (significantly) fewer errors than the current approach, which is having a human decide. I don't claim that I can design an experiment which could selve as an indication whether we are improving upon human judgments, but I think this should be the goal.
Reflecting upon my view, i think it comes from the experience of training ml-algorithms. You are always minimizing errors, but you goal is almost never to make 0 errors, because often your data is noisy and you are probably overfitting. I know the medical enviroments are more sensitive, but I can't really wrap my head around how we could design a learning algorithms that does not make any error and works on all abnormalies. I think it will always missclassify.
Rephrasing my argument: I think the approval should be given if an significant expected improvement over the distribution of real-life abnormalies can be detected and not over the uniform-dsitribution over all abnormalies.
EDIT: detecting out-of-distribution samples is hard and I don't think this is a solution and leads to a false sense of security.
The problem with neural networks is that they can reconstruct something that looks "normal", not necessarily something that is accurate. The more abnormal the scan, the more likely it will get reconstructed as something that looks perfectly fine even when it's not.
What I meant: There's probably a medical reason why you want such a product and if a more readily available MRI saves (really significantly) more lives than the chance that it might miss some abnormalies which could lead to death, then I think we should allow it. That's what I meant with a stochastic view. If we, for example, only have a few scans per hospital available because the chance might exist that we missclassify something and lots of people get worse or delayed treatment because they are not high enough on the priority list to get access to a super-resulution MRI with a fidelity they don't really need (again, i don't know anything, just to illustrate my point), then I think something is wrong.
His argument just sounded dismissive without giving a, to my uninformed point of view, valid reason.
1. If an MRI can be done 10x faster with the same results except in exceptionally rare cases, might that not still be a win? Order of magnitude reduction in time may translate to substantial reduction in cost and increase opportunity for applications. It seems like it is worth considering whether these benefits might be worth compromising the accuracy of the imaging.
2. How accurate are radiologists at diagnosing / detecting these rare abnormalities that validation might miss? If radiologists are actually pretty mediocre at this, might it be OK to make the scan slightly imperfect if the next stage (the human) is already very imperfect?
2. There are thousands of different abnormalities. From what I understand about the FDA validation process for this sort of thing there would be only 10s of abnormalities. There are likely, many, many of them that are quite obvious to radiologists. And once again, this would be a question that should be studied carefully when people's lives are at risk, instead of just assuming that it will be fine then going ahead to "move fast and break things"
I agree 100% with this, but how can this question be studied of this research to develop these systems doesn't go forward? You earlier characterized the FastMRI research as, in your view, "actually very dangerous." As I see it, the research here is potentially extremely valuable, and the danger comes not from the research, but from somebody deciding to deploy it without considering these questions. Typically the road from research program to wide deployment is quite long, and I disagree that we should discourage the research because of potential flaws in the productization process. (Unless there is ill will on the part of the researchers, which I'm assuming there is not).
The argument that "our system is already bad so we should just merge this new bad component because it doesn't make it worse" is bad in software, and unacceptable in medicine.
If the scanning process has a sensitivity of 99.999%, and the next stage in the signal chain has a sensitivity of 50%, and we consider what happens if the MRI sensitivity drops to 99.9%, that's well in the noise in terms of diagnostic value. Use some of the extra money freed up by doing the MRI 10x faster to pay a radiologist to look at the scan for 10% longer, and perhaps the net accuracy has improved.
What is unacceptable about this kind of holistic reasoning about the system? High performing systems are frequently not composed of perfect components.
Omitting 90% of samples (based on 10x speed claim) leaves an awful lot of room for bizarre errors.
And besides, let’s say tomorrow they have a method to do it tomorrow: how do they prospectively scam patients? How do they deploy the algorithm in a clinical setting? For any of this as a product to work, it would have to be integrated into a mri controller. Unless I’m eating my words at RSNA this year and deep mind is presenting their work, I’ll remain highly skeptical that this is going anywhere beyond a PR story that’s been sold to the media.
But if you are trying to bring this to masses one can start with with something "simple" like bones or some some relatively trivial organ. Not that MRI prices themselves are dropping much - gotta wait for room temperature superconductors.
Rather than saying "very dangerous", it would be safe to say that some individuals woudl not be well-served, but ideally, the overall health of the population would increase for a reasonable expenditure.
The key will be to train artificial neural networks to recognise the underlying structure of the images in order to fill in detail omitted from an accelerated scan."
Ah, right, what I want is for an ANN to invent information in a medical image. It's one thing to upscale textures in a game, but I can't see the use for this at all in a medical imaging device.
The point here is making people healthy, not providing some sort of validated theoretically clean design. If the rcts say it works, bring on the deep learning voodoo.
(edit: I, for the record, want to trust in average accuracy.)
Even if it happens more rarely than a doctor missing an anomaly on the scan, it doesn't feel right. A patient had a good chance to be diagnosed and he wasn't.
What's more, in case of normal MRI a patient or a doctor can ask another doctor to have a look, but in case of AI and the fast scan described in the article, the AI's interpretation of data is final, unless you go make another scan, this time in the traditional way.
You're focusing on the person who got falsely detected as healthy, and are ignoring the people who would be correctly detected as unhealthy. That's why the important question is expected outcomes.
I don't really care whether the doctor gets to be morally culpable or not. I'm not sure why I would ever care about something like that as a patient. If I get sick and die, the fact that a person was responsible rather than an algorithm gives me precisely zero comfort.
You don't need high costs to charge a lot.
They were pitching it to a medical group, and they were like that's great for patient care but how does it cut costs to the organization...
Adding more "cameras" to our MRI so we can do parallel imaging is expensive.
From the perspective of a MRI purchaser (say clinic or hospital director), maybe you can squeeze 1 or 2 more cases in a day, but it seems like a marginal improvement overall. I think cardiac is clearly the exception where you bring on board potentially new functionality with quicker acquisition.
Google cloud services voice generation uses models/algorithms developed by DeepMind, it's not directly a DeepMind product.
There is some discussion towards this direction: https://www.wired.com/story/can-ai-be-fair-judge-court-eston...
For criminal cases though: the current judicial system is wayy too punitive. And an AI that would apply the letter of the law would likely criminalize society even more than what has already happened so far.
One happy scenario would be if the laws were more responsive and were changed to not be so punitive since the AI would have a high rate of conviction.
But then, you might have other failure scenarios. Rich people buying AI programmers and hackers to mess with the system.
Its a constant game of outsmarting the latest tech.
We are in for some truly exciting times.
javascript:window.location.href='https://m.facebook.com/l.php?u='+encodeURIComponent(window.location.href);DeepEye AEye