Why is it for the best? Lonely feels right, even though by all objective measure I’m definitely not.
I value the existing people and relationships in my life, and that keeps me from changing too much and grounds me in reality and society, which is probably good for me and for society at large. I think that this sort of thing happens to everyone.
Maybe we strain against our harnesses and the web that we're in, and sometimes the web holds fast, or sometimes the network shifts and comes into new, better and more harmonious alignment.