LAN IPs or WAN IPs?

If you're using public/private keys you can use the "from" option for the keys. But it's not fool proof.