I annotate my Kindle books as well. But at least twice now, I've lost all my annotations because the publisher "updates" the book.

I'm sure that problem won't exist forever (and it doesn't exist for titles that are never updated). But it certainly reduces my trust in the platform. Which reduces how much I take advantage of it.