I use it all the time to correct password mistakes: I would be really irritated if that went away: in fact, I frequently use devtools on my laptop to change password inputs to text inputs

It is kind of helpful, but I agree that it should be an opt-in in accessibility settings.