Of course energy is scarce! We can't afford to send very heavy things into space. We can't send a radio signal into space that is so loud that you can be sure as hell everything within 100 light years is going to know we are here. We can't build superstructures, even if we got rid of the military. We could probably build a huge particle accelerator if we got rid of the military though...