Edit: reflecting on my comment I realize everyone, me included, is looking at this wrong. There is a Constitutional issue - Fourth Amendment "secure in papers and effects". Nobody has a right to just look at & act on the contents of your "papers" (now extending to digital video etc), and contractual access thereto must be respected. You may not like the contracts limiting access to something, but you have a natural obligation to respect them. Copyright and patent law were stopgap measures in place for where such controlled access was hard to implement.
Just a thought.
There is also a physical difference, which has been pointed out many times: if I take your car and dinner plates, you no longer have them. If I make a copy of your data, you still have it.
There is also a contemporary debate about whether the term of ownership for physical property should be for limited times, or whether rent should be charged on physical property. Of course, the debate is not framed this way, it is instead framed in terms of levying property taxes, sales, taxes, and inheritance taxes. This is another example of how framing the debate can affect the outcome.
Is this accurate? Many of the early thinkers applied Lockean property theory to intellectual property and we have many of them referring to it as a right. John Locke himself thought that his theory justified intellectual property rights, even before the particular legal concepts of patents and copyrights existed. Whether or not you agree with Locke, it seems false to claim that those who created IP laws in the U.S. would not have been influenced by such thinking.
In fact, many early US court cases used Lockean property theory to justify patents and copyrights, suggesting that they did not view it as just a pragmatic solution to the problem you bring up, but a fundamental right.
Here's one recent source to justify what I am claiming:
> we have many of them referring to it as a right
It is a right (re-read the text: "... to secure ... the exclusive Right to...") but it's not a fundamental right. Not all rights are created equal. There are fundamental rights (sometimes called "recognized" rights) which are the inalienable rights to which men are endowed by their Creator (to use the terminology of the Declaration). These exist independent of any law. Then there are other "granted" rights, which exist because a law has been passed. For example, the right to vote is a granted right in the U.S., not a fundamental right. Granted rights can be taken away by changing the law. Recognized rights can't. At least that's the theory.