I think that, in many cases, the ruling classes worry more about morale (and it's extreme failure, revolution) when there is a war on.
But, you raise a good point about other impacts. You care more about factories and farms if you need war material and soldiers' rations.