If you want it to both host the inference AND host the harness, then yes, you should firewall one from the other in some way, e.g. with VMs.