With all respect, that's nonsense. Where do you draw the line? Your morals? My morals? The victim's morals?
This is why we have a justice system, so that there is one place where you can say "that is wrong" and "that is right".
Forming a mob because "well, that person didn't akshually commit a crime, but we don't like the way they think about sex" is a primitive and regressive viewpoint.
The correct way would be to petition to make a law against whatever act you don't like. Not to say "let's leave it legal and instead simply punish the person".
No one should be facing a societal punishment without due process.