In terms of additional features:
- Support for Sieve scripts - LOVE this http://en.wikipedia.org/wiki/Sieve_(mail_filtering_language)
- Way faster loading time, snapper interface
- Lots more customizability (look at the display settings for an individual folder: https://files.app.net/1/79748/aXTHb4q16UPxgBvF2RCedd9jMSV2u4...)
- Some different interface features that I really like (your mileage may vary), like always showing starred messages on top for specific folders
There's lots more in terms of customizability and different weird configurations they allow you to do. They've done a pretty good job of hiding the complexity for non-power users, but it's still really accessible if you're willing to read through lots of preference screens.
There are some features FastMail does not have that Gmail does. The two big ones for me are undo send and composing in a new window (although you can just open the whole FastMail interface in a new tab and it only takes a second to load; opening Gmail in a new tab could take 10+ seconds in my experience). I use the FastMail web interface full time and am just as efficient, if not more, than I am with Gmail. The keyboard shortcuts are pretty much the same, so there wasn't even a learning curve.