I did all the time in the Android 2.x era. But it still works well, with the big caveat that there has always been hassle to use a Xserver on android. As far as I know there's no wayland app. Also there is lacking progress on integration. The chroot'ed distro generally doesn't integrate with android interfaces, and it's hard to do yourself if you're not rooted. Termux is a pretty nice implementation, with special integration.