https://github.com/rcmaehl/MSEdgeRedirect is a decent band-aid on the problem.

You can use Chris Titus Tech's Windows Utility: https://github.com/ChrisTitusTech/winutil

The Tweaks section has a checkbox for removing Edge. I removed mine using that.

On Windows 10 with IE and Edge removed I ran into a situation where Windows update stopped working. The only fix I could find was to install Edge then try the updates again, which worked.