Things to do in the Hudson Valley, the example I have in mind of a non-city area: expansive hiking trails for walking/biking, a river for rafting/skiing/boating/fishing, great family-owned restaurants all over, lots of nice historic sites such as the FDR estate and Vanderbelt mansion, a drive-in (unfortunately a rare institution these days, and obviously there are tons of normal movie theaters around), lots of good thrift/antique stores, hunting, tasting the fresh cider/whatever from local orchards (and getting great meat/produce from farmer's markets along with that), some concert halls around that play orchestras, horseback riding. If you want some stuff like classic theater/art galleries/etc you can find those around too, and a lot of stuff done by colleges. I'm sure I've missed a lot but this should be enough to make my point.
The city has some good stuff like the Museum of Natural History but not enough for me to want to live there.