That would still require some sort of NDK backend for the Qt toolkit, since X11 is not compatible with the native Android windowing system. I'd imagine that's no small feat.
There is already an Android port of Qt in progress here, with a lot of things (including Qt Quick and QWidgets) already working: http://sourceforge.net/p/necessitas/home/necessitas/ Several apps using Qt have already been published in Google Play.