How do you get X11 to work though. Don't you need an X11 server running on top of the existing Android display server?
What I would really like to see is an Android back end implementation for wlroots. Or alternatively, a small Android(/termux) app that just acts as a simple Wayland compositor, that compositors can then use as a back-end. I found an issue about this some time ago, but can't find it anymore.