Doctors just repeat advice given by national boards. These organisations are a bit slow, but still update their advice every few years, and these are heavenly reliant on statistics & research.
Just read Harvard's nutritional advice pages, they are exactly what a doctor will tell you.
The problem is nutritional science is highly unreliable. And the main reason is, that it's incredibly difficult.
Lots of the generic advice given is based on large scale studies over long years of population in the advice against red meat etc. But there are just too many variables. Which is why they keep changing their advice, however they thoroughly understand statistics.
Also the main focus has been on risk factors instead of understand in the mechanisms behind certain things, partially because the mechanisms are just so darn complicated.