I don't believe that's the case. At least not if we're using income as a proxy for wealth. Arranged by income, wealthier households in general tend to be larger households.
It's well established that the "top 20%" by income contains more than 20% of the earners - lots of dual-income couples - and also contains more than 20% of the people; the "bottom 20%" contains less than 20% of the earners and people. Seems to be true for 1% as well. If you want to check, there's a nice table of household size by income here:
http://en.wikipedia.org/wiki/Household_income_in_the_United_...