If you sideload it as an unpacked appx in developer mode rather than an unpacked extension it doesn't do this.