AI Can Detect Alzheimer’s Disease Six Years Before a Diagnosis
ucsf.edu
ucsf.edu
Meaning, 100% of positive cases in the test set were correctly identified, and 82% of negative cases in the test set were correctly identified. That corresponds to a 0% false negative rate and an 18% false positive rate. The test set is 40 imaging studies from 40 patients.
There are medical tests which have such a high rate of false positives that in practice in the absence of other indications you would ignore a positive result, because the only possible follow-up test would be a non-risk-free biopsy, and therefore, for your peace of mind, it's probably better not to do the first test at all.
[1] that's mortality rate which I am using as a proxy for incidence rate, though the actual incidence rate is presumably higher (mortality rate from the CDC)
After this test you now have updated priors which may not be good enough to make a certain diagnosis, but wouldn't it still be useful combined with another independent test that has similar rates, since you'd be using these updated priors?
That alters the Bayesian priors quite a bit.
In addition, you can monitor the progress of someone who "tests positive" over time and see if that is really true.
Part of the issue with Alzheimer's treatments is that we may be intervening far too late. These kinds of tests may help that.
Other commenters have noted that the sensitivity is 100% with specificity 82% (false positive rate being 18%). I wanted to provide my own take on what that means for me as a future provider (I'm considering becoming a neurologist after medical school). I'm assuming to the data science crowd here, it's almost second nature to know what these numbers really mean in practice, but maybe I can provide some outside perspective.
When considering screening tests in medicine, we have to always balance the benefits and risks of conducting these tests on patients. We have to figure out how reliable a test is, and how patients benefit from earlier detection.
In this case, it's an imaging test, so noninvasive. However, it's a test that requires radiation (positron emission tomography or PET). So we already have to determine if that extra radiation dose is worth the increased risk for something like cancer. In an elderly population, it's almost certainly worth the scan given the radiation would not significantly impact their decades of accrued radiation damage.
Now, what happens if a patient has a positive test, 6 years earlier than they would normally? Let's assume for a moment that it was a true positive test. They could receive treatment earlier, which could improve their quality of life. They could adjust their risk factors to slow down the progression of disease. The treatment could have side effects, such as increased blood pressure. If we apply that to a large population scale, would we increase mortality associated with heart disease by treating patients with suspected Alzheimer's earlier?
Lastly, I wanted to touch on the effects of a screening test with a large amount of false positives. I would argue that a screening test should be allowed to have lots of false positives, simply because we can always do other tests (neuropsychiatric evaluation like MOCA score) to improve our accuracy of detection. However, if we do these other tests, we have to again balance the harms with the risks. Mammograms, for instance, could give false positives that could warrant a breast biopsy. In the case of Alzheimer's, a false positive could lead to stress and depression in an elderly population already at higher risk for stress related disease.
In short, screening tests are great if there's a way to do something about the disease. As far as I know, early prophylactic treatment (with current medications) of Alzheimer's does improve quality of life, slowing progression of the disease manifestations, with relatively few side effects.
There's plenty to delve into regarding the risks and benefits of screening tests: Here's a good framework for those interested.
public bool HasAlzheimer(GlucosePetScan patientScan) { return true; }
I think that has more to do with the extended time frame than the actual ability of family and medical providers to see changes in a patient cognition and abilities.
(Not that you can't necessarily see cognitive decline externally earlier than a diagnosis, just that it seems like it'd be hard to make a clinical argument about persistent decline versus several poor nights of sleep, for example.)
You need to live separated for one year to have it approved for one thing. And if you have children under guardianship you are required to attend family counseling or such.
I assume that what is refereed to in the upper comment is the waiting period and other requirements.
Personally I did not know this was the case with altzheimer even though I am Norwegian.
That often happens rapidly, and in many cases putting the Alzheimer's patient in full-time care is the only option -- even with a caring, involved spouse.
I watched my grandfather go from a slightly forgetful goof to confused, violent, and impossible to manage in <3 years. My grandmother, not doing so well herself, struggled to keep up but after a couple years putting grandpa in a facility was the only real tenable option.
There are several things in this discussion that make not much sense to me (a non-Norwegian):
* How would a divorce court refer to a (confidential) medical diagnosis? In some countries, at least, even a criminal court cannot easily access such things.
* Why would the law refer to a diagnosis of a particular disease (when the patient might still be healthy) rather than refer to actual cognitive impairment?
* What's the hurry? Can't you get a divorce fairly quickly just by moving out and filling in some forms?
* One of the major legal implications of divorce is that you don't automatically inherit or get insurance pay-outs. Not the most obvious thing to want when your spouse has a terminal illness, though in some cases you know there's no money involved. Even if you're named in the will there may be bad tax implications if you're not married to the person you're inheriting from.
* Someone mentioned children, but divorce doesn't have to relate directly to children: courts have to deal with the children of unmarried couples, and they have to deal with the children of couples that are separated but still married, so I'd expect a court to worry about the relationships and the welfare of the children and not to care very much whether the parents/guardians are officially married or not.
I would guess that these are all areas of law in which there are a lot of differences between jurisdictions.
I think you are making the assumption that the unhappy and trapped spouse is going to provide loving care. The Alzheimer patient may be better off with other family or in state care than being dependent on somebody who may be hostile to them.
Marriage is a social contract. Some of the benefits (lower income taxes, preferential inheritance, etc) are in recognition that you are taking on some of the responsibilities that would otherwise fall to society.
What you are responsible for and what benefits you enjoy from being married is very much a product of that culture. In my case, if my wife is ill, I do have to provide for her (Fun fact: in Japan you require your spouse's written permission to get a divorce except in certain circumstances). However, it would not surprise me that some other cultures (perhaps Norway) have different responsibilities. The world is large and "marriage" means different things to different people.
Edit: Pointing out flaws/possible exploits in a system is not the same thing as endorsing their use.
The reason I ask is because there's some description of the processes we know indicate Alzheimers, but there could be new signs this algorithm has identified that could be applied more directly?
https://github.com/jddunn/dementia-progression-analysis
I was using OASIS's public dataset so I only had ~150 images to work with, instead of ~2000. I used transfer learning from ImageNet's dataset to try and get usable results. I also had super limited testing (15-20 patients), but got ~60% accuracy with ~13% false positive rate.
It could be useful to apply those same transfer learning techniques in your team's model.
What are the downsides of these treatments on a healthy brain? Why are we not administering them preventively to anyone with a family history of AD?
To recent yet.
People that suffer from bipolar disorder and are being treated with lithium seems rarely if ever to develop dementia, but the dosages are much much (1000 times, or so) higher than what we add to drinking water.
According to my doctor the primary issue with adding higher concentration of lithium (still, way below therapeutic levels for mental disorders) to drinking water is quacks that make a lot of noise when the topic comes up. They see it as adding mind altering chemicals to water, which couldn't be further from truth.
People and their fear of chemicals though. Reminds me of http://www.dhmo.org
"Lithium can cause nausea, diarrhea, dizziness, muscle weakness, fatigue, and a dazed feeling. These unwanted side effects often improve with continued use. Fine tremor, frequent urination, and thirst can occur and may persist with continued use. Weight gain and swelling from excess fluid can also occur. Lithium can also cause or make skin disorders such as acne, psoriasis, and rashes worse. The amount of lithium in the body must be carefully controlled and is checked by blood tests."
"Lithium can poison a developing baby (fetus) and can increase the risk of birth defects, including heart problems.
Lithium treatment is UNSAFE in women who are breast-feeding. Lithium can enter breast milk and cause unwanted side effects in a nursing infant.
Heart disease: Lithium may cause irregular heart rhythms. This may be a problem, especially for people who have heart disease.
Kidney disease: Lithium is removed from the body by the kidneys. In people with kidney disease, the amount of lithium that is given might need to be reduced.
Surgery: Lithium might change levels of serotonin, a chemical that affects the central nervous system. There is some concern that lithium might interfere with surgical procedures that often involve anesthesia and other drugs that affect the central nervous system. Lithium use should be stopped, with the approval of a healthcare provider, at least two weeks before a scheduled surgery.
Thyroid disease: Lithium might make thyroid problems worse."
Clearly Lithium isn't side-effect free, so it would be pretty reckless to add something like that to drinking water.
"In general, the only significant problems with low-dose lithium are tolerability and thyroid issues. About 1 person in 10 to 15 gets dull, flat, and “blah” (the “lithium made me a zombie” effect, overrepresented in online testimonials). I explain to my patients in advance that if this happens, we’ll give up on it. This adverse effect does not diminish with time and generally persists even if the dose is reduced. Then there’s weight gain: is it dose-related? To my knowledge, this has not been established. I nurture some hope this is so.
That leaves the thyroid issue. Thyroid-stimulating hormone (TSH) levels must be monitored even with low-dose lithium. In women, induction of hypothyroidism is extremely common—and almost predictable in women with a family history of thyroid problems. The latter may be an uncovering of an autoimmune disorder. If your patient has a high-normal TSH value before lithium (eg, 2.5 mIU/L or above, and certainly above 3 mIU/L), she is at even higher risk for lithium-induced hypothyroidism.1
So monitor closely, and even more closely in those at greater risk: for example, every 6 weeks until a trend (up, or flat) is established. Once you have established that the TSH level is not rising, the probability of later hypothyroidism due to lithium is much diminished and you can back off to getting a TSH level with your 6- to 12-month check of creatinine.2"
1. http://www.psychiatrictimes.com/bipolar-disorder/low-dose-li...
Normal therapeutic dosage is around 300mg and 500mg lithium per day, and blood levels should be around 0,5-1,2 mEq/L. A concentration at 0,7 mEq/L as quoted in the article is within normal values and dosage, and not really considered low.
The real dangers is NSAIDS or ACE inhibitors which can push your concentration up quite rapidly, but that's easy to avoid, and still not very relevant until you're at around 1,0 mEq/L, give or take. Concentration above 1,6 mEq/L is considered an overdosage and comes with a lot of risks, thyroid being one of them.
Anyone put on a therapeutic dosages of lithium will have their blood checked frequently, often starting with twice a week for an extended period.
But again - in dosages that are 100-1000x times higher than that they want to add in the drinking water.
Ie, "I can't eat a spoonful of vaccine, yet you want me to inject it into my blood?!"
>We've added lithium to drinking water which has been linked to decrease in dementia.
Pick one.
https://www.ncbi.nlm.nih.gov/pubmed/984241
>The authors suggest that lithium can have a clinically useful effect upon impulsive aggressive behavior when this behavior is not associated with psychosis.
That's a quote from the abstract. Lithium is a behavior-altering chemical.
Here is another study where lithium is found to alter behavior (although, admittedly, in the brains of children which were identified as misbehaving):
https://www.ncbi.nlm.nih.gov/pubmed/6819289
The claim that there could be a non-dietary chemical element that altered the behavior of miscreants without any impact at all on the behavior of regular people would take extraordinary evidence before I'd believe it. Every other psychoactive drug impacts healthy brains if for some reason it is administered.
It sounds like you're agreeing with me that it alters your mind while you are taking it. I'm confused by the English language use going on here. The plan is to micro-dose entire cities with lithium, which means we are interested in what lithium does when you are on it, because entire cities will be on it for decades of elapsed time. The evidence clearly indicates that the people drinking this water will have their behaviors altered, potentially for their entire lives if they just so happen to stay in cities that medicate their populations in this way.
In fact, the entire point is that people's behaviors will be altered. If lithium was mentally inert, then it would not be useful as a mental health drug, and nobody would be suggesting adding it to the water supply to improve public mental health.
Now, to make the argument more longwinded but also more correct, if lithium treated stomach ulcers and the children were misbehaving because of discomfort, it would be impacting human behavior without being a "mental drug." However the evidence does not indicate that the counterfactual situation I proposed is true - in fact, just about every study agrees that lithium is a mental health drug prescribed to treat mental health problems.
Who's the "we" here? The facility I worked at adds only the following chemicals in order: sulfuric acid (pH control, since the algal sex orgies in summertime causes pH to shoot way up), poly-aluminum chloride and a long-chained coagulant polymer (coagulants), ozone and sodium hypochlorite (disinfection), sodium hydroxide (more pH control), fluoride (the obvious), ammonium (for keeping the chloride around longer), and zinc orthophosphate (pipe corrosion control). There's also unused tanks for potassium permanganate (raw water control), alum (unused alternative for PACL as a coagulant) and calcium thiosulfate (ozone quench).
There's no lithium in the system at all--I've walked past every tank and pump.
I often see https://outline.com/ links on HN, does HN allow sci-hub links?
She went to researchers who tested her with sweat from 6 diagnosed patients and 6 controls - she identified the 6 diagnosed patients correctly, and one of the controls who was later diagnosed with it but had not been yet.
https://www.telegraph.co.uk/science/2017/12/18/woman-can-sme...
(Also, as a fascinating aside which probably isn't what the GP comment meant, _loss_ of sense of smell is one of the earliest symptoms of Alzheimer's or Parkinson's. Why? Good question.)
The primary problem, I think, is that you'd have difficulty convincing someone to fund this research without a priori knowledge - e.g. if you don't already know that there are (relatively) readily externally visible biochemistry changes from a degenerative brain problem, why would you see if you can train an animal to smell it?
It's similar to the question people posed after the PS3 signing key leak came out - while it is the case that Sony was signing all PS3 (and PSP, if memory serves) binaries with the same (all-zeroes?) random input, so they leaked information sufficient to eventually retrieve the private key from enough samples, why would you think to check if they did that without already knowing?
(Or, more generally, the large domain of problems that is relatively-trivial to verify a correct solution but infeasible to test all possible solutions in order to find one.)
That would point towards some molecule being eliminated from the body after some kind of silent poisoning. That could be a reasonable explanation for parkinson and other diseases, if proven true.
Trying to match the smell with some common products could be very interesting.
I was recently reading "Surely You're Joking, Mr. Feynman", the last chapter contains a story about a researcher who was studying rats in mazes. The researcher wanted to put the rats into a long corridor of identical doors, and teach them to go exactly 3 doors down from where they were put in and get some food. The rats always went to the exact door where they last got food from though, no matter where they where put in. The researcher didn't know how they could tell the doors apart; was it smell, sight, sound, etc? He was determined to eliminate all these possibilities so that the rats would only have their entry point to go off of, and then they would learn to go 3 doors and get food. The final change he made before succeeding was to put the rat maze on sand, and then the rats finally stopped going to the door which last had food. Apparently the rats were able to use the subtle sounds the floor made to determine their exact location in the long corridor.
Then Richard Feynman mentioned that this researcher was largely ignored and unrecognized. He hadn't discovered anything about rats, so much as he had discovered something about experiments on rats. Other researchers continued to do rat maze experiments without putting their mazes on sand, and would publish papers without considering the possibility that the rats were navigating by the sound of the floor.
Coming back to my original point, I wonder if it was proven that Parkinson's is correlated with a smell, would such an odd experiment even be considered by anyone in the research community?
-- Otto von Bismarck
This quote need to be updated for modern times regarding performance of AI/ML models.
> The data show high doses of radiation may cause cancers. But there are no data to establish a firm link between cancer and doses below about 10,000 mrem (100 mSv – 100 times the NRC limit).