If you two were alone, you had sex, and you go to a doctor later and there are no signs of violence, how can you prove you actually said "no"? Honest question.
Our system is only slightly above ones that require a male relative to have witnessed the assault before accepting that it wasn't the woman who committed a crime.