I do the same on Safari on iPhone. Enable the accessibility setting and browsers can't lock your zoom anymore.