I just sold my Harley (literally this morning). And you're totally right about the vibe. I had a 2017 Roadster (a much more upright bike than the cruisers you think of when you think of Harleys) and any time someone asked, I'd explain "I ride a Harley, but I'm not a 'Harley guy'". I would never roll around with other Harley riders.
I think the most telling thing was that when I priced my bike out, average mileage for that bike at that age was ~6500 miles. Which made my 52,000 miles a liability.