AT&T Web-based chat support will do it in about 5 minutes. Ask for a "port block" so other carriers can't port your number away from AT&T.

Even if you don't use SMS as a second factor, unless you regularly switch carriers, there's no downside to doing this.