although gender and sex is used interchangeably - even in the most progressive circles - gender is a reference to a set of cultural behaviors and roles, a form of expression, while sex is functional and 99.9999% chromosomal and binary in humans
you are familiar with this, for example, when someone says "be a man" in response to someone's lack of assertiveness, this has nothing to do with whether they have a penis and the binary male contributions to reproduction, it is referring to a behavior expression that is indeed arbitrary but shared
swapping genders therefore has nothing to do with what sex you are attracted to, when adopting that paradigm, especially when adding genders outside of the binary cultural behaviors
hence being "straight" doesn't change and is only a problem for someone else