what about a mechanism that 'locks' the trackball in place at rest, and then requires a little bit of force to 'unlock' the trackball to track?
I could see a "sliding vs static friction" trick for a passive mechanism, but anything that worked would so wear out very quickly.