Criminalizing sex work hurts women. It forces them to operate without protection, without regulation, and under threat of criminal prosecution.
So yes, it's very much a women's rights issue, as legalizing and regulating the industry would allow women who are interested in the work to do so with protections and without fear of jail time. They can operate with relative security.