If you are actually a Boltzmann brain, then you're a gazillion times more likely to have an experience that has nothing to do with the actual state of the universe than you are to coincidentally hallucinate an argument that you're a Boltzmann brain based on rules that actually apply to nature. Therefore, there's nothing to worry about.