You can uninstall for all users using the adb helper tool I don't know the command line to do it manually.

Yes it's not removed but at least the guarantee it won't run is quite strong.