The primary advantage of FeedBurner, for me, is the fact that it's an indirection between the RSS feed and the site. It meant that I could start with a blogspot blog, move it to a different domain, and ultimately transition to a different blogging stack, all the while not breaking subscribers.
The analytics were secondary. Google Analytics, while not specifically tailored for RSS feed usage models, still give a good picture of usage.