A Way to Reverse Coronary Artery Disease? [pdf]
jfponline.com
jfponline.com
1. No control group
You need to have a control group that continues eating a standard healthy diet that includes animal products. The 11% who were non-adherent could have been eating unhealthy diets which contributed to their instances of CAD. Without a control it could have just been eating a healthy diet that helped, not the exclusion of animal products.
2. No blinding
Of course a food consumption study is nearly impossible to double blind but at the very least the researchers could have been blinded. This also requires a control group.
3. Self-reported data
While it's very tough to get anything other than self-reported data for long term food consumption, it makes it far more likely that the participants will report inaccurate or incorrect data. Results tend to be biased because participants don't want to let researchers down and lie about adherence.
The past several decades have witnessed a substantial and sustained reduction in CAD. Nevertheless, CAD remains the number one killer of women and men in this country. Thousands of stable patients having stents experience no reduction in major cardiac events.6 While drugs have some effects on disease initiation and progression, these in- terventions do not address disease causation. Not surprisingly, most patients experience disease progression, more drugs, more im- aging, repeat interventions, progressive dis- ability, and, too often, death from a disease of western malnutrition, the cause of which has been largely left untreated. We have in press several patient experiences that exemplify the repeated failure of present-day cardiac drugs and procedural interventions, and that confirm the capacity of whole-food plant- based nutrition to restore health in “there is nothing further we can do” situations.36 In summary, the present cardiovascular medicine approach tested beyond 40 years can neither cure the disease nor end the epi- demic and is financially unsustainable. The safety, diminished expense, and prompt, powerful, and persistent results in treating the cause of vascular disease by whole-food plant-based nutrition offer a paradigm shift from existing practice. We think the time is right for a controlled trial. But in the mean- time, the data are sound and strong enough that patients should be informed of this option."
> These data convey a strong message of patients accepting empowerment to be the locus of control to arrest their disease and confirm that patients will adopt a significant lifestyle transition to plant-based nutrition to halt and regress what we believe is a largely food- borne illness.
In other words, they conclude that diet can impact CAD and some people will be willing to change their diet. No surprise there. The fact that the study was for plant-based nutrition holds very little relevance since there was no control group. It could simply be that people transitioned to a healthy diet. We can't know for sure without proper controls.
Knowing that CAD is the number one killer in several countries, I am all for studies like this being published, even with the lack of formal control group, after all, the numbers are pointing in one direction. If I had heart disease, I would have liked to know about this data.
Similarly the marked difference in effects between the groups - two thirds of the non-adherent group versus a single case in the 177 adherents, in terms of having another event? It's not like the benefits of vegetarianism all arrive the following day - I would have thought there'd likely be a few more in the adherents group that had an event while they were still 'in transition'.
It may all very well be true, but it does smell a little funny.
>These patients with established cardiovascular disease (CVD) were interested in transitioning to plant-based nutrition as an adjunct to usual cardiovascular care.
In other words, this study cannot establish that the statins these patients were already taking didn't account for their perceived health benefits.
The most interesting item in the article, was this, "We referenced the plummeting death rates from strokes and heart attacks in Norway during World War II when the German occupying forces confiscated their livestock, limiting Norwegians to plant-based nutrition.15"
I didn't know about this. This might be the only reliable evidence of the efficacy of plant based diets we have so far? I don't know the mindset of Norwegians back then concerning health, so I don't think the Placebo Effect played much of a role in final statistics, and they must have been under a lot of stress. I couldn't find the footnote 15, but will look harder.
Self reporting is an issue, but this is not the only type of study on the issue. It has been supported by international studies, animal testing, and countless studies about the health benefits of more fruits/vegetables and less meat.
0.6% recurrent event rate does not mean it was 99.4% effective. You need to know what the recurrent event rate would have been if everything else was the same and they hadn't followed the diet. Hint: if the normal recurrent event rate is 0.3% then they are worse off, not better (insert test of statistical significance here).
If the event you are testing for (recurrent CVA) is rare, then a large enough sample and proper statistical significance tests are even more important.
2. No control group
"Didn't follow the diet" is not a control group. They have, post-hoc, selected the subgroup consisting of "people unlikely to follow a lifestyle intervention". That group might also been the most likely to continue smoking, not take their medication, do no exercise, be too unwell to follow a rigorous diet, etc etc.
3. Subgroup analysis
Drawing a circle around a subgroup after your study and making inferences from them is an excellent way to get bogus results. (Classic example: Wimbledon winner prediction system. Email 2000 people at random with each player and ask them to bet $1 on that player. After you know the winner, get the subgroup of people who won, and ask them how accurate they think your winner prediction system is.)
" Patients were also asked to avoid sugary foods (sucrose, fructose, and drinks containing them, refined carbohydrates, fruit juices, syrups, and molasses). Subsequently, we also excluded caffeine and fructose."
The documentary "Forks over knives" - available on Netflix, describes this approach and has features interviews with Esselstyn as well.
More useful links:
[1] http://en.wikipedia.org/wiki/Caldwell_Esselstyn [2] http://en.wikipedia.org/wiki/The_China_Study
It seems like as if I wanted to prove that a television-free lifestyle improved health outcomes, so I studied a group that stopped watching television (and taking heroin.) I keep reading "plant-based" as characterizing the diet, including in the abstract, when the sugar they cut out was almost certainly plant-based too.
edit: Here are two critiques of The China Study: http://www.cholesterol-and-health.com/China-Study.html http://rawfoodsos.com/2010/07/07/the-china-study-fact-or-fal...
I'd be quite interested if and how these criticisms of The China Study apply to this study.
[0] https://en.wikipedia.org/wiki/Nurses%27_Health_Study
[1] http://www.amazon.com/The-China-Study-Comprehensive-Implicat...
[2] "A Mediterranean-type diet reduces risk of incident CHD and stroke. Fish intake reduces risk of stroke. Nut and wholegrain consumption reduces risk of CHD. Refined carbohydrates and trans fats increase risk.", see:
1. The study was self-selected - we don't know to what degree. Did they place flyers in vegetarian recruiting grounds?
2. They explicitly state that they are not including 8 patients that experienced thrombotic or embolic events or had progression, blaming them on other factors. That may be the case, but it is not ok to exclude patients on that basis and report your adverse event as 1% due to that.
3. There is no marker of cardiac function provided in the study / we have no idea if the groups had similar baseline function.
This is a critical point because amongst the 'non-adherent' group there is one patient who underwent a heart transplant. A heart transplant is a very rare procedure and is only reserved for extremely severe heart failure. If a patient in a study eventually underwent a heart transplant, that patient very likely had horrific cardiac function at the beginning of the trial.
What is more telling is that such information could have been statistically provided very easily: They could have chosen to provide a summary of number of patients who had experienced infarcts; number of patients with aberrant ECG rhythms; number of patients on spironolactone (a medication reserved for use for late in heart failure); Left ventricular ejection fraction estimated from TTE; The list goes on.
Instead they provide only the sexes, 'symptom reduction', and adverse events.
In my opinion this study provides little more than anecdote that patients should switch entirely to a plant based diet, and at this point I would certainly not recommend a patient of mine to switch. However it should be studied in greater detail and it would be interesting if stronger evidence emerged.
http://well.blogs.nytimes.com/2011/08/18/bill-clintons-vegan...
Thanks
Indeed, there are huge limitations in this study:
1. No control group
2. Self reported dietary adherence
3. Obvious possibility of the healthy adherer effect (people who voluntarily present for interventions and are adherent to dietary changes will probably also exhibit other healthy behaviors like exercise, mood control, better sleep etc which introduces confounders.
4. No monitoring of medication adherence. Perhaps these people simply started taking their medications more regularly while in this program. Medication adherence among patients with CAD is notoriously terrible.
5. Possibility of sick stopper effect in their non-adherers (sickest people also most likely not to take their meds, precipitating worse outcomes).
6. They note that on average their patients lost 18 lbs; perhaps weight loss alone was responsible for their improvements
7. They exclude some of their sickest patients
8. They report symptom relief in adherent patients but don't mention what that means. Do they report less angina? Did they see plaque size reduction? If the former, you have introduced potential for placebo effect.
It would be an equivalent population who weren't asked to change their diets.
There are multiple reasons the patients in this study might not be comparable to participants in other studies or to the general population. Age, gender, average disease severity all need to be controlled for. And if nothing else the simple fact the patient knows they're being monitored could have an impact on all sorts of behaviors.
Yeah, these are interesting results, but without a control group you can't say for certain what is causing an effect or, actually, if an effect exists.
Which is actually an ethical quandary when you think about it. A doctor's ethics are really tested when he has to say to some patients "sure, I think you should change your diet and you'll probably die if you don't, but you're part of the control group!"
One more ethical (and still statistically somewhat interesting) way of administering such a study would be to bring in doctors advocating different sorts of diets. The Cleveland Clinic hasn't done such a thing but they probably could: they've got a group that advocates the rigid vegan diet and another that advocates the Mediterranean diet. Not as good as having a control group that continues to subsist on cheeseburgers and coke but it actually can test a few specific ideas, like the vegan claim.
You're right, of course. But whether a study is scientifically valid and whether it is ethical are two orthogonal questions. Similar concerns are why most cancer therapy trials end up looking more like A/B testing than classic experimental/control experiments. The point I was trying to make, though, is that you need at least two groups which differ only by a small set of (ideally one) known variables to draw any real conclusions
This is a very commonly known effect, which makes me more than a bit suspicious of this particular study.
This is also why a control group with random assignment is necessary, particularly in the social sciences. There are simply too many confounding factors to make epidemiology useful in basically any way.
We are told that 39 participants (22%) had documented reversal of CAD. But we are given zero data or information about those patients. What was the average reversal? How many of those patient were on statins as well as the diet? We don't have even the most basic definition of how "reversal" is defined for that 22%.
My gosh, the name of the study is about "reversal" Yet we are given no data at all similar to that seen in both the Ornish studies. At least Ornish gave precise percentage reversals in the arteries with blockages. Average reversal for tertiles of aherence in percentage terms. Something we could analyze in terms of effectiveness. Something that could be measured. In this study all we are told is that there was reversal in 22%, with no further information. Not even a clear definition of the word "reversal".
Something is very wrong with that. Many Esselstyn followers are in it for the long haul. Sure, its nice to know there were less cardiac events over the 3.7 years, but we're looking for a process lasting 20 or more years into the future. What the heck does reversal mean if you don't define it and don't give any data about those who got reversal.
Totally disappointed in the details, apparently chosen to be omitted. As though the reader, the patient, will just blindly accept the "22% reversal" claim with no data given.
Does anyone have knowledge of if that data will ever be released, or a definition of "reversal" given?
My husband’s book, Prevent and Reverse Heart Disease is widely available. ‘ On his web site, dresselstyn.com you will find his counseling DVD for purchase
Or you may come to the Cleveland Clinic Wellness Institute for his monthly counseling seminar. Details available through his secretary Jackie at 216-448-8556.