The Nazis overran nation states with mobilized armies. A small segment of the populace with guns would have been irrelevant.
[EDIT: anyway, I actually agree with your main point that a lot of private guns will be useful as a deterrent and in practice against professional armies]