Thanks for the feedback! I've not had the occasion to try gravel tires.
For me, the main reason to use road tires is grip on asphalt, not rolling resistance improvment. On your commute, you may need to stop in an instant, and more grip = quicker stop = safer (I've had a few close calls, especially downhill under rain).
Obviously, that's also dependent on your regular commute road condition.