Thats to load the initial view. You can toggle between genders very conviniently. Wouldnt be a good idea to load the entire friendslist in one go.
Still, if that permission is giving you problems because of people's reactions, just showing the entire friend list (with paging, of course) may not be a bad idea.