Exactly. Trying to turn it around like the issue is due to the agency (hence blaming) the victim, when really it’s not down to that person’s agency at all, rather something they are subjected to through no choice of their own.
Your comment in fact is one of the worst forms of victim blaming, and you may not be aware that you’re even doing it: justifying victim blaming as though it is some sort of justified focus on “what you can do” when the problem should not be made to be about that or justified as such.