I hear you. It is not the best user experience I agree, but it does take away the (tiny) server component. I will try to improve the experience.

And by the way, cool idea to use the pen on the smartphone.