Agreed. At my first company we used to make sure every employee had a fresh packet of business cards and a mug on their desk for the first day. A nice box packed with thoughtful stuff you'll need is a good idea especially if it includes a few pair of gender-neutral-adult-size-onesies emblazoned with the company logo.