Actually, not really. Germany was awarded the '36 Games in 1931 which is before the Nazis came to power. And even in '36 it wouldn't have been so obvious exactly how bad the Nazis were going to turn out to be. Much easier to say in hindsight.