This is pretty much my experience as well. The trackpad is my only complaint about the machine.
There is some ongoing work to reverse-engineer the trackpad firmware (which is apparently behaving badly) from this guy: https://github.com/akirakyle/pinebook-pro-keyboard-updater/t...
There's also apparently a bounty: https://www.bountysource.com/issues/88375235-reverse-enginee...
If there is a firmware solution, then I think I'll have no complaints left for the pinebook pro :)