I use the AT&T prepaid service as well (GoPhone) on a factory unlocked smartphone; I don't use the data, but have the ability to turn it on if I need to.
As it turns out, one can just get a GoPhone sim at an AT&T store and get it activated then and there (no need to take a dumbphone or your smartphone there at all). The sim costs 99 cents. I have been using this sim for the past 6 months.