You're right about a key element being a (broadly defined) set of common values. But hunting also includes a broadly defined set of common values: appreciation for the land and conservation, love of marksmanship, support for 2A rights, etc. Which is why, of course, hunting-based mostly-retirement communities like Brays Island exist:

http://www.braysisland.org/ "Recognized by enthusiasts as one of the premier locations for bird hunting in the southeast, Brays Island provides everything you need for a memorable and productive hunt. Of the island's 5,500 acres, 3,500 are untouched woods, marshes and fields set aside as nature preserves to guarantee your hunting enjoyment..."

"The Brays Island Gun Club is the premier site for the enjoyment of shooting sports. With the finest facilities for clay shooting, we offer numerous forms of target shooting, including skeet, trap, five-stand, plus a newly re-designed sporting clays course featuring a picturesque 15 stations..."

I'm not a hunter, but the inn looks quite pleasant. I'd go there for a visit if I were retired.