I've been having the amusing thought lately that one possible solution is perhaps making the system a bit more chaotic. Maybe with the safety of levels through tricameralism or maybe even tetracameralism.
So.. in the house of rep districts you allow for popular vote to recall reps and also to hold popular referendum in said districts on whether to split them. If people are upset enough with their representation and can get enough to vote to spit the district then the district is split. This would intensify the situation some however you enable merging so when the popular will exists to merge then there is the chance as well.
A lower level would exist under the house of representatives in which instead of people in the district voting for that lower rep, people from a random generated district that votes differently would have the ability to vote someone in. Essentially San Fransisco would be able to vote for a lower rep in some random super conservative district and vice versa. The entire point of the lower rep is to essentially troll the house of rep. We'd give them powers such as being able to call for a town hall meeting twice a year, a direct debate twice a year, petitions without the usual required permits, an an ability to freedom of information act everything the house rep does.
The upper end of the tetracameral system would be two senators appointed by the state legislature prior to the 17th amendment restoring some state power. The mid level would be directly elected senators, however states would gain a few more based on population.
Nonetheless, the districts portion is what I wanted to cover but felt I'd share most of the idea so there would be more background around the concept. The ideal would be both on the state level and federal level, the lower houses would be open to recall and open to popular vote for district splitting or merging. With a lower house rep voted on by outside parties to try to curtail silo thinking. While the upper chamber returns state interests back to the federal government; some populist sentiment I personally feel needs to be curtailed and think our biggest constitutional mistake was that of the 17th amendment.
It'll never happen of course. But it's fun to think about.