A good first step would be proportional representation.
The best thing we can do to address gerrymandering is to keep partisans from coming up with zany voting districts which are optimized strictly for their own political benefit.
Cities aren't dead yet. It still makes sense to divide carve out districts according to population centers and geography.
Our lives and our industries are tied to the land we live on. It's not just rural and urban: there's coastal and landlocked, desert and forest, tropical and arctic, etc. Each of these areas have unique concerns when it comes to policies that effect their land and the industries that their land lends itself to.
Hillary Clinton of Arkansas was Senator for New York.
A couple-hundred miles is nothing for a modern carbetbagger.
We're talking about state reps here, so moving the goalposts doesn't help you. State reps are usually representatives of a couple of towns and some land. They aren't senators or governors. You can't adequately represent people at that level if you aren't around them and never meet them.
Specifics aside, I fully agree that I'm much more likely to have something in common with a software developer across the state than the school-teacher next door.
> Can't we elect representatives based on some other grouping?
What other "grouping" is more reasonable than geography? Are we really that atomized as a society that there is no common interest amongst neighbors?