Yes. All you have to do is whitelist your clients' yggdrasil addresses in your firewall.
in pf syntax:
table <yggdrasil> persist file "/etc/yggdrasil-allowed"
pass in quick on tun0 inet6 proto tcp from <yggdrasil> to port $services