I've tried going with and without food before the gym, but settled on without. I feel more alert and less sluggish when I don't eat before working out.

If you're strength training, you may run into issues though.