I wouldn't install Amarok (avoid loading Qt in Gnome and vice versa). RhythmBox does not handle an iPod well if that matters for you, but Banshee does. Banshee relies on Mono.
Zim is a little-known note-taking tool that relies on text files and uses a Wiki format.
AbiWord and Gnumeric are good programs to have around when you don't want to start MS Office. Copy the .ttf and .otf font files from your Windows machine and install them in Linux if you want them available.
Inkscape is good to have around for drawing.
What else do you think you'll need?