I can't talk for all "weirdos", but let me tell you about my personal fears.
I fear that I will have to give up my intellectual honesty. I fear that I will have to start caring about politics (which I consider waste of time and something that shows the worst parts of our nature). I fear that I will have to start playing signalling games. I fear that I will have to censor my words and my thoughts, so that I don't express an opinion that is unpopular this week (winds on the Internet change fast). I fear that I will have to accept and participate in absurdity and irrationality I try so hard to stay away from.
I'm a very open, tolerant and accepting person. Just like every other "weird nerd" I know. But the crowd that tries to overwhelm us is not open, not tolerant, despite waving the banner of "diversity" and "equality". I fear I won't be allowed to be a nice, honest, decent person with interest in technology anymore.