Is the structure of that argument the same as the structure of your argument for physical property? (in which case my argument would be that there are very relevant differences)
There are pragmatic arguments against it: The costs copyright and patents impose on the market are huge. Not the prices, but all the good things that become difficult or illegal to do.
On principle: even if an IP system has some practical benefit, we usually set a pretty high bar for restricting people's communication or creativity. Is copying properly up there with fraud and slander?
I think we can come up with much better ways to pay for art. (Kickstarter is one.)