Edit: Dang, and yea we also the sun and cosmic rays increasing the earth's mass. Radioactive decay also decreases the mass.

So are we getting fatter or slimmer? By a quick Google survey it depends which estimates one trusts, but probably losing a bit.