There are actually several (published and non-published) ways to exploit that type of configuration, here is one example:
If you're talking about using that exploit to allow access to the victim's machine from the internet: that won't work because listening interface for the x11 server is localhost, not the LAN interface.