While I agree that "positive rights" frequently amount to legally mandated wealth transfer, saying your neighbors must "work as slaves" is a bit extreme. A slave has no choice as to whether they work, what they work on, and how they work.
Personally, I have no problem with the fact that property rights are not absolute (taxation and regulation being the primary inroads). That limitation of the property right results in much that I think is good.