That's an awful spiral. Correct me if I've misunderstood, but this is caused by bad neighbours? If this is really the root, take the leap and move out! Perhaps you can try flat-sharing next.
I live in a rural town, which I love (courtesy to introversion) but sometimes it can get lonely, and yes, that self-reinforcing spiral then happens. I try to go to tech events in big cities at least once a month so I'm reminded that I 'belong' to this community, even though most of the time I don't interact very much. (And that's ok too, be comfortable with who you are! :)) Seems to be working, that and monthly meetups with old friends and nurturing an appreciation of my own company. This is just me though - try different things so that you can find which suit you best. Chin up!