Unfortunately yah. You can’t just point to the next man you see and toss him in jail.
Bad things happen to people, it more than sucks. But without evidence who raped you there is little you can do. Sure report it, but no action can be taken on any man is no evidence of who did it.
But way to go, comparing somebody being called a name to rape. Clearly they are the same thing.