Consider converting the PDF to HTML, and then annotate the HTML, http://web.hypothes.is
Three years ago I faced this problem while creating a prototype to annotate research papers, and used a client side library by http://annotateit.org which posted annotations to my own server.
The conversion from HTML to PDF was handled by http://pdftron.com DocPub.