You clearly bother yourself WAY too much with what other people are thinking.
Believe me, you'd be better off pursuing what you truly love instead of trying to fit into what you think is 'normality'.
Of course even then you need to be active at least to the point of finding the others out there, but I'd still contest it to be the easier way.
For some reason, not having someone else look you in the eyes with a similar amount of excitement just isn't the same.