If there is an intermediate server involved (probably a STUN server), it just helps set up the connection. The actual UDP packets don't go through any middle man. This is how residential VoIP services have been working without requiring any firewall/router configuration by the customer. It's also the same thing when you set up an iChat or Skype video call with both parties being behind a NAT.