If there was an option not to connect to AT&T wifi hotspots I couldn't find it. Unlike most wireless routers it wouldn't only automatically connect to ones I've used before, it would eagerly connect to any AT&T hotspot.
There is no way to remove it via the UI. You sadly need a rooted phone to remove it.