Same. Being into anime (and gaming, and RPGs, and sci-fi, etc.) marked you as an outcast nerd when I was a kid.

Nowadays, most of it is nearly mainstream. Granted there is still some weirdness like grown 40yo men obsessed with schoolgirl harem anime...