I'm sure that copying a work for your private consumption would be considered non-commercial in nature, but his assertion that it doesn't affect the potential market for the item wouldn't hold up.
It's clearly affecting the market for the original as you are removing yourself from the market for it. Creating a copy for your own consumption harms the copyright holder's ability to market a reproduction to you.