I get what you mean and I do sympathize somewhat.

The fact is, however, that modern society doesn't fit everyone. Since we won't allow people to withdraw from society that means we're actively forcing people to live a specific way of life that some simply cannot handle.

Simply putting more pressure on those groups will result in the forming of parallel societies and in the long run that means that those parallel societies will form a separate culture and try to secede. If we stop that there will be conflict. History tells us such conflict will be very bloody, no matter who ends up on top.

This is a cycle that Western Civilization has dealt with for thousands of years. Personally, I wouldn't mind trying to break it this time.