It's ultimately a pointless endeavour because you don't have access to the source code or even the ability to binary patch and flash your own firmware on the most of the phone components. The modem in particular is a black box. Might as well stick with Android and run a Linux environment inside an app like Termux.