In a cosmology with Boltzmann brains, your memories of opening doors and not seeing random fluctuations are more likely to be part of a random fluctuation than to be caused by having actually experienced that.
Heck, your moment-to-moment experience of being in a room is extremely unlikely compared to just a temporary Boltzmann brain hallucination upon arrival. No need to go find a door, just wait 10 milliseconds for the "Oh wait actually I'm in space and about to die" sense information to start pouring in. Oh it didn't happen? That's just because you only arrived a millisecond ago and have fake memories of it not happening and are still in the hallucination phase... (repeat indefinitely).
This moment-by-moment thing is what makes Boltzmann brains such a paradox in terms of epistemology. In a cosmology with Boltzmann brains, most of the entities who've just made some conclusion about Boltzmann brains are themselves Boltzmann brains.