As long as arguments like the "trans panic" defense exist and are viable in courts, I feel like it's better for queer people to stick together.

Your idea while honorable ignores the reality that queer people experience and that one of the two parties in the US is planning to strip away more of their rights. (See: Recent RvW ruling that had their next targets set, like same sex marriage)