It's similar to owning a Ferrari, and then not actually driving it day-to-day. People don't want to suspect their priced possessions to wear and tear.
To rent out your Ferrari you'd have to run an agency and couldn't use it as you wanted to. Which kind of defeats the purpose of a luxury good.
(It's hard to find data on how prevalent this is... From one article, it looks like a Palo Alto realtor estimated in 2015 that about 20% of home sales were to Chinese investors, with about half of these leaving the house unoccupied: http://sanfrancisco.cbslocal.com/2015/04/28/realtors-printin... )