The specific purpose of RustDesk is to have the middleman making remote access across networks easier. It's intended to replace TeamViewer, LogMeIn, etc. not VNC or RDP.

You either pick a middleman you want to trust or you run one of your own, if you don't want that or need the features if offers RustDesk is not for you.