Author here - yeah I hear you. I love the hypothesis interactions when they happen on my site but the UI is a little aggressive (especially on mobile). All about tradeoffs unfortunately.

FWIW I posted a little UX teardown of the different annotation platforms here if you're interested: https://tomcritchlow.com/2019/02/12/annotations/