You're not wrong, the objective is assumed to be Lipshitz which is continuous.