> I can still install it with `adb` but nobody else can anymore.

You don't need adb to sideload applications. If you enable sideloading, you can copy it onto the phone and run it that way.