Windows 10 (IoT) LTSC 2021. It lets you uninstall Edge with just a right-click. And it doesn't have any 'modern apps' and Store preinstalled.
in a non-shady/license-compliant way
LTSC is cleaner out of the box and has much longer support, but otherwise it's not that different. And Edge on LTSC still does annoying things, such as adding a Bing search box on the desktop, for example.