Assuming the former right does exist, then there is a conflict of rights (between the wishes of males who want to be housed with females, and females who want to be housed without males). Rights conflicts like this are not solved by simply telling one group (in this case, women) to shut up and stop complaining.
Where the ACLU comes in here I have no idea.