Unfortunately you can hardly have it both ways. Most people only have one primary interest in their lives, and form groups around it. You don't seem to be like that, which makes you an exception. Of course there are other exceptions like you, but they are by definition hard to come by. So either you get really into one group, or a little bit into many of them, your choice.