TF has runtime cost based optimization, which is inside Session.run()