It shouldn't also take away from the rights of others. When prison labor is obtained below minimum wage, or under conditions or terms that workers would not accept, you hurt low income workers and drive down their wages in aggregate.

In my opinion, prison labor should only be used for public works. Cleaning up parks and that sort of thing. Giving a captive labor stream to private enterprise is only good for the owners of the select few firms who can take advantage of it.