Just change the question to? Are you OK with us continuing in my room because blah blah, otherwise we can just do it in the lobby.

Basically, you give them power to decide where they feel comfortable most. Especially first time around.

“Can you come to my room in 30m to do blah” is an order basically, so as a result you already create hostile situation irrelevant of gender.